Generating a playlist based on a shared attribute between content items

ABSTRACT

The present technology pertains to generating a playlist based on a shared attribute between content items. The present technology includes receiving a request to generate a playlist to including first media content from a first collection associated with the user account and second media content from a second collection associated with another user account. The technology also includes generating the playlist to include the first media content and the second media content when it is determined that a condition has been met, where the condition includes at least an identification of the user account as recommended to the another user account. The user account can be provided with access to the playlist, and an interactive element that, when selected, causes a computing device associated with the user account to be directed to an e-commerce service at which a product is available for sale.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation and claims the benefit of U.S.application Ser. No. 17/725,474, filed on Apr. 20, 2022, and claimspriority to U.S. provisional application No. 63/177,323, filed on Apr.20, 2021, the content of both are expressly incorporated by referenceherein in its entirety.

TECHNICAL FIELD

Media content providers offer copyright-compliant content from largecatalogs. Interaction with media that users consume through suchservices is typically limited to creating, editing, storing and playingmedia.

BRIEF DESCRIPTION OF THE DRAWINGS

Details of one or more aspects of the subject matter described in thisdisclosure are set forth in the accompanying drawings and thedescription below. However, the accompanying drawings illustrate onlysome typical aspects of this disclosure and are therefore not to beconsidered limiting of its scope. Other features, aspects, andadvantages will become apparent from the description, the drawings andthe claims.

FIG. 1A and FIG. 1B illustrate an example environment associated with amulti-media platform in accordance with some aspects of the presenttechnology.

FIG. 2 illustrates an example system of functional components inaccordance with some aspects of the present technology.

FIG. 3A, FIG. 3B, FIG. 3C, FIG. 3D, FIG. 3E, FIG. 3F, and FIG. 3Gillustrates aspects of an example method for facilitating a liveplayback stream by a multi-media platform.

FIG. 4 illustrates an example method for producing a live playbackstream by a multi-media application associated with a user account of amulti-media service in accordance with some aspects of the presenttechnology.

FIG. 5 illustrates an example method for connecting to a live playbackstream provided by a multi-media service by an audience member clientdevice in accordance with some aspects of the present technology.

FIG. 6A and FIG. 6B illustrate example user interfaces of themulti-media application pertaining to a live playback stream inaccordance with some aspects of the present technology.

FIG. 7A and FIG. 7B illustrate an example method for engaging fans ofartist accounts in accordance with some aspects of the presenttechnology.

FIG. 8 illustrates an example method for presenting one or more userinterfaces associated with live playback streams in accordance with someaspects of the present technology.

FIG. 9A illustrates an example streaming service user interface of amulti-media application in accordance with some aspects of the presenttechnology.

FIG. 9B illustrates an example live playback session management userinterface in accordance with some aspects of the present technology.

FIG. 9C illustrates an example sound effects menu page in accordancewith some aspects of the present technology.

FIG. 9D illustrates a user interface for selecting transition options inaccordance with some aspects of the present technology.

FIG. 10 is a block diagram of an example method for enabling artistfinancing, reevaluating terms and/or repayment of the financing, andproviding an incentive to the artist in accordance with some aspects ofthe present technology.

FIG. 11 illustrates an example method for determining a value of mediacontent or a sample of a media content in accordance with some aspectsof the present technology.

FIG. 12 illustrates an example method for implementing distributedledger technology in media management in accordance with some aspects ofthe present technology.

FIG. 13 illustrates an example user interface that advertises acurrently playing live playback stream in accordance with some aspectsof the present technology.

FIG. 14 illustrates another example user interface of the multi-mediaapplication in accordance with some aspects of the present technology.

FIG. 15A and FIG. 15B illustrate example user interfaces for creating auser account with the multi-media platform in accordance with someaspects of the present technology.

FIG. 16A, FIG. 16B, FIG. 16C, FIG. 16D, and FIG. 16E collectivelyillustrate a flow of user interface screens of multi-media applicationin accordance with some aspects of the present technology.

FIG. 17 depicts an illustrative block diagram illustrating a system forperforming techniques described herein in accordance with some aspectsof the present technology.

DETAILED DESCRIPTION

Disclosed herein are multi-media platforms that support modification ofdata streams, such as music, in near real-time collaborative mediaexperiences, lending, machine-learning driven social engagement, anddistributed ledger-driven licensing and media content management models.In some embodiments, the present technology pertains to a multi-mediaplatform configured to provide a playback experience whereby a hostoperating a client device, such as the client device executing themulti-media platform, can host a live playback stream. A live playbackstream can include the playing of recorded digital media content in aplaylist to a group of client devices in a simultaneous manner.Additionally, a live playback stream can also include live media,provided by the client device of the host. The live media can includevideo streams, live performances of music, dance, theater, etc. In someimplementations, the live media can include commentary, e.g., textual,audio and/or visual information pre-recorded or recorded in nearreal-time. In this fashion, a host is able to modify a playback streamin near real-time with their live media.

The present technology exists in a context of a multi-media platformwhere media content is stored in a central data center and is availableto access, e.g., play, stream or download to client devices, streamingon connected devices such as a particular speaker, etc. In this context,the present technology provides mechanisms to intelligently multiplexrecorded media content from a first source with the live media from asecond source, and playback in near real time.

In some embodiments, the recorded media content, e.g., stored in thecentral data store, is configured to be downloaded onto an audiencemember client device such that recorded media content can be played backlocally on the audience member client device. Meanwhile, the live mediais recorded by the client device of the host for transmission to theaudience member client device. In some embodiments, the presenttechnology utilizes an alternative infrastructure, such as a server toplayback the recorded media content, and multiplex the live mediareceived from the client device of the host with the recorded mediacontent, whereby the pre-multiplexed live playback stream is sent to theaudience member client device without storing the recorded media contentlocally on the audience member client device.

When the multiplexing takes place at the audience member client devices,the present technology provides for higher quality media contentplayback than if the media content were multiplexing were to have takenplace at the client device of the host. The present technology can sendmedia content to the audience member client device prior to playback tobe cached, allowing for transmission of higher quality media content.When the multiplexing occurs at the audience member client device, thereis potential that the audience member client device can actually receivehigher quality media content than experienced by the host. This occursbecause every client device could receive the highest quality mediacontent that their subscription provides. Second, the present technologymakes more efficient use of network bandwidth. In the instance wheremedia content that is part of the live playback stream has previouslybeen downloaded and cached by one or more connecting client devices,greater efficiency is achieved as there is no need to re-transmit themedia content. Since many people tend to repeatedly engage in mediaprogramming that matches their tastes, it is likely that some mediacontent will repeatedly be encountered. Therefore, it is likely thatsome media content that is part of the live playback stream has alreadybeen downloaded and cached by audience member client devices.

When the multiplexing takes place at the multi-media platform, thepresent technology still provides higher quality media than multiplexingeverything at the client device of the host. When multiplexing happensat the multi-media platform, the quality of media content is limited bythe network bandwidth between the multi-media platform and the audiencemember client device. But when multiplexing happens on the client deviceof the host, the quality of media content is limited by the subscriptionof the host, and bandwidth between the client device of the host and themulti-media platform, and the bandwidth between the multi-media platformand the audience member client device. At each hop, quality can onlydegrade. Additionally, the connection between the client device of thehost and the multi-media platform needs to download and upload mediacontent so it might be the most bandwidth-constrained link. The presenttechnology also provides more efficient use of network bandwidth thanmultiplexing everything at the client device of the host. If therecorded media content and the live media were multiplexed at the clientdevice of the host then the recorded media content would need to bedownloaded to the client device of the host from the multi-mediaplatform before playback. Thereafter, the multiplexed live playbackstream including the recorded media would need to be transmitted back tothe multi-media platform to be distributed to the connecting clientdevices.

The present technology also synchronizes the recorded media content withthe live media, e.g., during playback, so that the two sources can bemultiplexed at a location other than the client device of the host thatcontrols the live playback stream. In one implementation, this isachieved by inserting the live media at predefined time stamps of therecorded media content. The predefined time stamps may be host-definedor system-generated generated based on data analysis of past behavior.In some cases, the host may be notified with prompts to provide contentthat can be inserted in those specific time stamps of the recorded mediacontent.

Techniques described herein provide for sharing media experiences withinthe multi-media platform. In some embodiments, the present technologydisclosed herein includes an infrastructure for users to collaborate onexperiences (such as digital concerts, opining on a podcast innear-real-time, sharing music playlists with friends and family, and soon). Such experiences can also include specific e-commerce triggers,e.g., where an artist offers a specific listener custom merchandise orconcert tickets. Accordingly, while streaming music, the listener canengage in an e-commerce transaction with the artist. The live media inthis case can be customized for each of the listeners, where onelistener receives an option to buy tickets to one concert, while anotherlistener receives an option to buy merchandise (e.g., via a payment linkon the music platform or other associated payment platform).

As used herein a user can any entity utilizing the present technology,such as engaging with the multi-media platform discussed herein. In thecontext of the present technology, a user can take on one or more roles.For example, a user can operate with the multi-media platform in a roleof a host, artist, or audience member. However, any one particular usercan be a host in one context and an audience member in another context.An artist can take on multiple roles at once. For example, an artist canalso take the role of a host simultaneously.

In some embodiments, hosts can apply “mix rules” to apply to transitionsbetween live media content and recorded media content, and achieve someof the engagement described above. In other embodiments, hosts can apply“mix rules” between live media content or recorded media content, suchas two songs in a playlist. Audience members can also apply “mix rules”or “filters” to annotate the media (e.g., apply voiceovers, narratives,etc., in real-time or near real-time as the media is being streamed).Mix rules can define or control one or more aspects of the playback ofthe songs to which they are applied, including, but not limited to,sound effects, tempo, pitch, volume, and fade-in and fade-out times. Mixrules can also assign specific interactive features to portions of themedia such that engagement with the interactive features triggersactions. For example, a mix rule can be assigned to media that allows anartist to be paid or tipped, or a fan to receive specific merchandise asdescribed above. Mix rules can be predefined by the user, systemgenerated, or even generated in collaboration with one or more users.

In some embodiments, machine-learning techniques can be used to analyzethe media content being accessed at any given moment, gauge the reaction(e.g., explicit or implicit) of the audience and modify the playlist oraudio based on real-time or near real-time audience feedback. In someimplementations, as described herein, the modification of the playlistincludes annotation with live media, mixing with other media content,and so on.

Techniques described herein provide systems and methods for creatinglending offers within the context of a media streaming service. In someembodiments, the present technology described herein analyzes datarelated to the consumption of media content (e.g., commentary, livemedia, recorded media content, engagement with the live media, streamingcount, streaming artists, engagement with advertising content, and thelike) to provide lending offers, such as cash advance, to the artists.In some examples, the present technology disclosed herein generatesmetrics that predict the success of media, artists, etc., based on whichthe lending offer may change.

Techniques described herein provide for applying distributed ledgertechnology and non-fungible tokens (NFT) to media licensing, mediaassignments, and media residuals. In some embodiments, the presenttechnology disclosed herein maintains the digital rights associated withmedia and tracks digital rights associated with the media content as therights move from one user to another. In some embodiments, the presenttechnology provides advantages of lowering the friction in transactionsinvolving media and providing a more efficient marketplace for mediacontent. Previously, transactions involving rights to public uses ofmedia content were infrequent and generally negotiated by sophisticatedparties. However, increases in computing power and the multi-mediaplatform have made it so a wider group of users can create new mediacontent that are either derivative works of other media content (songremixes), or that utilize a sample of a media content to create anentirely new work (using an audio sample in a new song, using a videoclip in a social media post, creating a meme from a digital image,etc.). The implementations described herein allow for speedytransactions that acquire the necessary rights to use existing mediacontent or portions of media content to create new ones. Further, as thevolume of such transactions increases, the present technology providesan infrastructure that can support an efficient marketplace (in marketeconomics terms). In such an environment, the present technology canalso provide various machine learning tools to help suggest values forthese media content and samples of media content. As the value of mediacontent can be dependent on social trends, machine learning tools canhelp artists to receive fair compensation for their media content in adynamic marketplace.

In some embodiments, techniques described herein can utilizemachine-trained models to determine data associated with audiencemembers. For example, the machine-trained models can determine mixingrules that dictate multiplexing of the recorded media content with livemedia. In some examples, a virtual assistant or other bot can usemachine-trained models to automate communications between specific usersassociated with the service provider described herein, for examplebetween an artist and an audience member engaging in an e-commercetransaction. In some examples, the machine-trained models can beutilized by a computing component to generate recommendations that canbe used to streamline communications as described herein. As an example,a communication can be received and analyzed using a machine-trainedmodel as described herein. In some examples, the communication can firstbe parsed using natural language processing, image processing, or thelike. In some embodiments, after the communication is parsed, anexpression (e.g., temporal expression, geographical/location expression,a commercial expression, etc.) can be identified in the communicationand the expression can be used to determine a response to thecommunication.

In some embodiments, techniques described herein can utilize storedand/or determined permissions and/or rules to route communications tousers such as certain artists, audience members, hosts, and/or devices.Based on the rules, certain users can access media content or distributesuch media content. Further, based on the rules, certain users may beable to control the live playback streams. In some cases, a user may beable to assign access conditionally or provisionally to another user,e.g., for a predefined item. In this manner, the recorded media contentstays the same, but the live media content is switched between two usersor multiple users.

Techniques described herein support optimized switching betweencommunication channels and/or services/platforms based on context. Insome embodiments, the contextual analysis can be through modelinterpretation of temporal terms. This is to say that in the use case oflive playback streams, the multiplexing may switch between variousclient devices or users based on context. For example, if a playlistincludes a variety of songs from a variety of artists, in someimplementations, the control of live media may switch from artist A toartist B based on the song that is currently playing.

From a user's perspective, messages from different services/platformscan also be consolidated on one interface and, in some examples, can beaccessed via a software developer kit (SDK) platform and/or applicationprogramming interface (API). Disparate services/platforms (e.g.,first-party or third-party) can utilize SDKs or APIs to exchangecommunications via techniques described herein. Further, techniquesdescribed herein allow authorization triggers to be set such thatcertain communications are automatically routed to certain users basedon the context of the communications. For example, if a user requests acoupon, a computing device can send an authorization request to amanager (e.g., via a chat interface, a push notification, an email, atext message, etc.), and can transition control back to the originaluser after the coupon request is granted. Thus, in some examples, foreach communication, there can be a customized tree of interaction thatdictates the flow of information between the two users (and all userentities). This tree can vary based on each interaction and eachcustomer-user relationship. Such a tree can be stored as a rule.

Techniques described herein offer various improvements over existingcommunication technologies. For instance, techniques described hereinare directed to a consolidated communication user interface, whereincommunications sent and/or received via different communication channelsand/or service provider platforms can be accessed via a single accesspoint. In some embodiments, such a consolidated communication userinterface provides an improved user experience and reduces interactionswith a user computing device.

With existing techniques, users receive communications from differentplatforms and different communication channels. Such communications canbe difficult to manage as they can be stored in different locationscorresponding to the various platforms and/or communication channels. Asdescribed herein, a consolidated communication user interface allowscommunications to be converted into a “standardized format” forpresentation via a dashboard, or other user interface, of a usercomputing device. A communication incoming from a communication channeland/or platform can be converted by a network-based communicationmanagement component from its existing format into a standardized formatfor storage and/or presentation via a user interface (e.g., aconsolidated communication user interface). Such a convertedcommunication can be stored in the standardized format in anetwork-based storage device (e.g., a data store) and can be presentedvia the consolidated communication user interface.

Moreover, in some embodiments, techniques described herein can utilizethe centralized nature of a network-based service provider and itsability to provide multiple services for users associated therewith. Thecentralized nature of the network-based service provider enables theservice provider to access data across multiple platforms associatedwith the multiple services and to determine context based at least inpart on that information.

Further, techniques described herein are directed to using machinelearning and/or artificial intelligence to intelligently determine whichcommunication channels and/or platforms to route communications betweenartists and subscribers. In some examples, such machine learning and/orartificial intelligence can be used to analyze content of an incomingcommunication (e.g., using natural language processing, imageprocessing, and/or the like) and to intelligently generate a response tothe incoming communication. In some embodiments, models can be trainedusing machine learning and/or artificial intelligence usingcommunications and/or other communications transmitted via the serviceprovider. That is, in some examples, communications sent and/or receivedcan be used as training data to train a model that can be used fordetermining context of future incoming communications. In some examples,such a response can be automatically sent (e.g., without requiringadditional input from a user) and/or a response can be associated with arecommendation for responding to the incoming communication. In someexamples, the machine learning and/or artificial intelligence can beused to facilitate a payment transaction, such as tipping an artist. Theuse of such machine learning and/or artificial intelligence can providean improved user experience and can reduce interactions with a usercomputing device. That is, such intelligence can reduce user interactionwith a computing device by automating and/or semi-automating parts ofcommunications. Additionally, in some examples, machine-learning and/orartificial intelligence, as described herein, provide improvements tovirtual assistants (e.g., bots) such that virtual assistants canunderstand requests/queries and respond to said requests/queries withmore accuracy.

In some embodiments, techniques described herein can provideimprovements to existing systems with respect to media quality,bandwidth utilization, access control, security, and/or computingefficiency. As described herein, techniques can use rules, which can bestored on and/or determined by a network-based computing system tocontrol access to certain communications and/or operations (e.g.,sending communications), which can provide security and efficiency tosystems as described herein. Techniques described herein can utilize atechnology-based solution of filtering communications using storedand/or determined permission(s) and/or rule(s) to overcome problems inexisting systems. Various embodiments will now be described in furtherdetail with the help of one or more figures.

The processes herein are illustrated as collections of blocks in logicalflow graphs, which represent sequences of operations that can beimplemented in hardware, software, or a combination thereof. In thecontext of software, the blocks represent computer-executableinstructions stored on one or more computer-readable storage media that,when executed by processor(s), perform the recited operations.Generally, computer-executable instructions include routines, programs,objects, components, data structures, and the like that performparticular functions or implement particular abstract data types. Theorder in which the operations are described is not intended to beconstrued as a limitation, and any number of the described blocks can becombined in any order and/or in parallel to implement the processes. Insome embodiments, one or more blocks of the process can be omittedentirely.

Turning now to the figures, FIG. 1A and FIG. 1B illustrate an examplesystem for or facilitating a live playback stream by a multi-mediaplatform. A live playback stream can include the playing of recordeddigital media content in a playlist to a group of client devices in asimultaneous manner. Additionally, a live playback stream can alsoinclude live media, provided by the client device of the host. The livemedia can include video streams, live performances of music, dance,theater, etc. In some implementations, the live media can includecommentary, e.g., textual, audio and/or visual information pre-recordedor recorded in near real-time. In this fashion, a host is able to modifya playback stream in near real-time with their live media.

In some embodiments, a host can operate a computing device, such as ahost computing device 102, to utilize services offered by themulti-media platform 108. The host computing device 102 can beconfigured to communicate with the multi-media platform 108 over one ormore networks. In some examples, the host computing device 102 can haveone or more applications stored thereon that can specially configure thehost computing device 102 to communicate with the multi-media platform108. For example, host computing device 102 can have a multi-mediaapplication 106 running thereon. In some examples, multi-mediaapplication 106 can be provided by the multi-media platform 108 (e.g.,to access one or more services associated therewith) to access mediacontent. In some examples, the multi-media application 106 can be webbrowser based application or a standalone application downloaded fromthe Internet or an App store. In yet another example, the multi-mediaapplication 106 can be an instant application having a subset offunctionalities of the full multi-media application where the subset isdetermined based on context. In one example, the subset can includestreaming content and payment functionality. In another example, thesubset can include streaming content and lending functionality.

The host computing device 102 can be operated by a user having a useraccount with the multi-media platform 108. In some embodiments, the useraccount can be associated with artists having artist accounts, medialabels, publishers, or other users subscribed to a streaming mediaservice provided by the multi-media platform 108.

In some embodiments, the host computing device 102 can be used to host alive playback stream wherein a host can control public playback of mediacontent for an audience. The audience can be one or more users connected(audience member) to the live playback stream through multi-mediaapplication 106 operating on an audience member client device 110.

Any user account can be a host user account or audience member useraccount or artist account depending on their context. When a useraccount is hosting a live playback stream, the user account is a hostuser account. When the user is connected to live playback stream, theyare an audience member. Even artist accounts can be an audience memberor host user account. None of the user roles (e.g., host, audiencemember, or verified artist) are mutually exclusive. Any user of themulti-media platform 108 can take on one or more of these user rolesaccording to the context in which the user is engaging with themulti-media platform 108. Likewise, while different devices (e.g., hostcomputing device 102 and audience member client device 110) areseparately illustrated, the devices are not necessarily distinct. Theycan all run the same version of the multi-media application 106, and allinclude the same functionality when their respective user controls themto engage in such functionality. Accordingly, a device that is a hostcomputing device 102 in one context can be an audience member clientdevice 110 in another context.

Both the host computing device 102 and audience member client device 110also include a cache 104. The cache 104 is a temporary memory used by acomputing device for fast access to data. In some embodiments, the cache104 can be used to temporarily store media content that have beendownloaded or streamed from the multi-media platform 108. In someinstances, the media content can have been previously downloaded orstreamed from a previous playback of the media content. In someinstances, portions of the media content might be downloaded by themulti-media application 106 in anticipation of playback. For example,when media content are in a playlist or scheduled for playback as partof a live playback stream, the multi-media application 106 can downloadseveral media content (or portions thereof) in advance to ensureresponsive playback in the event that a user skips to a subsequent mediacontent abruptly. Once media content (or portions thereof) have beenstored in the cache 104, they can remain there until available storagespace in the cache 104 has been consumed, at which point, the oldestdata in the cache 104 will be overwritten. The cache 104 can also beused to store other data that the multi-media application 106 mightdesire quick access to in addition to media content.

While not shown, the host computing device 102 and audience memberclient device 110 can also include one or more persistent storagedevices such a non-volatile memory, such as that used to store themulti-media application 106. This persistent storage provides for morepersistent storage of data and applications. In some embodiments, mediacontent that has been favorited or downloaded through explicit action bya user can be stored in persistent storage. When media content arepersistently stored, the multi-media application 106 can also look tothe persistent storage in the same way as it utilizes the cache to findlocal copies of media content and portions thereof. As used herein,references to checking the cache for local copies or media contentincludes checking the persistent storage as well.

In some embodiments, multi-media platform 108 is a Software as a Service(SaaS) platform hosted on the Internet. The host computing device 102and the audience member client devices 110 can connect to themulti-media platform 108 over the Internet.

The multi-media platform 108 is configured to support services relatedto media content. In some embodiments, the multi-media platform 108 canprovide access to a collection of media content 116 stored in the datastore 114, whereby the host computing device 102 and the audience memberclient devices 110 can download or stream media content 116 forplayback. In some embodiments, the media content can be recorded mediacontent. In some embodiments, the multi-media platform 108 can allowsharing and/or editing of media (e.g., mixing, and/or remixing music)within the context of a media streaming service. In some embodiments themedia content 116 can also include recordings of live media stream andlive playback streams as addressed in more detail below. While the term“streaming service” is used herein, the provision of media content bythe multi-media platform 108 need not conform to any particular datatransfer technique or protocol unless otherwise stated. For example,media content 116 can be requested by host computing device 102 ormulti-media application 106 in advance and cached prior to playback ofthe media content. Media content can be songs, videos, vlogs, podcasts,interviews, mixes of songs such as remixes, covers, playlists, etc. Themulti-media platform 108 can also provide other services as describedherein. The media content 116 can also be stored along with variousmetadata pertaining to the media content. In some examples, the metadatacan include, artist name, title, album name, track number, playbacklength, associated artwork, rating information, analytical anddescriptive data describing at least one of a tempo, genre, or mood ofthe media content, user information, and artist information, etc.

The data store 114 can be configured to store data that is accessible,manageable, and updatable. In some examples, the data store 114 can beintegrated with the multi-media platform 108. In other examples, thedata store 114 can be located remotely from the multi-media platform 108and can be accessible to the multi-media platform 108. The data store114 can comprise multiple databases and/or servers connected locallyand/or remotely via a network. One example of data stored by the datastore 114 is a collection of media content 116, e.g., recorded media andin some instances, live media.

The media content 116 is stored in a least a highest quality version ofa recorded media content to which the multi-media platform 108 hasaccess. In some embodiments, the multi-media platform 108 can downsamplethe media content to a lower quality when required by network bandwidthrequirements or a quality of service defined by the terms of a useraccount. In some embodiments, the media content 116 are stored in avariety of quality levels to provide quicker transmission of the mediacontent 116 to client devices.

In particular, one service provided by the multi-media platform 108 isto facilitate live playback streams. In a live playback stream a hostuser account can control public playback of media content for thebenefit of audience members. The public playback can include designatingwhat media content to be played back by the audience member clientdevice 110, how and whether the media content are mixed and whattransitions to apply be media content or portions of media content, etc.In some embodiments, the media content for the live playback stream canbe preconfigured using a playback queue.

In some embodiments, the live playback stream also includes a liveperformance component as well. The live performance can includecommentary, just as a DJ might provide on a radio broadcast, but thelive performance is not limited to such. The live performance could be avideo performance capturing any live audio or visual component.

The multi-media platform 108 can facilitate the live playback streamthrough a collaboration component 112. The collaboration component 112can facilitate the live playback stream by advertising the live playbackstream to client devices so that they can learn about and connect to thelive playback stream and can connect the audience member client devices110 to a particular live playback stream.

A live playback stream can include multiple data streams. A hostcomputing device 102 can transmit a playback control channel and a livemedia stream to the collaboration component 112 at the multi-mediaplatform 108.

The playback control channel is a data channel used to transmitinformation including an identification of recorded media content to beplayed back during the live playback stream, playback controls,instructions regarding various effects to be applied to the recordedmedia content during playback, and multiplexing information to be usedto multiplex the live media stream with the playback of the recordedmedia content. The data regarding playback controls of the playbackcontrol channel includes playback synchronization information for theplayback of the recorded media content such as play, skip, and pausecommands. The instructions also provide various effects to be applied tothe recorded media content during playback including data describingcustom mixing or transitions to apply to the recorded media content. Themultiplexing information maps the audio captured by the microphone to atime-domain associated with a currently playing recorded media content.

The live media stream can include audio or audio-video media of a liveperformance. The data encoding the live commentary in the live mediastream is audio captured by a microphone, camera, or other device of thehost computing device 102. The live media stream can be a recording ofany live performance.

The live media stream can include encoded markers as reference pointsalong with the live performance recording. The playback control channelcan reference the encoded markers to indicate where that portion of thelive performance corresponds to the playback of the recorded mediacontent.

Users who are connected to a live playback stream provided by hostcomputing device 102 can listen to and experience the media content in amanner that is the same as or similar to the host. For example, theaudience members can experience the playback of the same media contentas is being played back on the host computing device 102 and followalong as the host controls the media content playback.

As illustrated in FIG. 1A, the host computing device 102 can transmitthe live media stream and the playback control channel to thecollaboration component 112 which can relay the live media stream andthe playback control channel to the audience member client devices 110.The audience member client devices 110 can then playback the mediacontent as instructed by the playback control channel and play the livemedia stream at the same time as instructed by the encoded markers inthe playback control channel. In this way, the audience member clientdevices 110 are responsible for combining the media content that areplayed back with the live media stream.

As noted above, the present technology provides for higher quality mediacontent playback than if the media content were streamed to the audiencemember client device 110. The present technology can send media contentto the audience member client device prior to playback to be cached,allowing for transmission of higher quality media content. Second, thepresent technology makes more efficient use of network bandwidth. It islikely that one or more media content that are part of the live playbackstream have previously been downloaded and cached by one or moreaudience member client devices 110. When this occurs, there is no needto re-transmit the media content. Since many people tend to repeatedlyengage in media programming that matches their tastes, it is likely thatsome media content will repeatedly be encountered. Therefore it islikely that some media content that are part of the live playback streamhave already been downloaded and cached by audience member clientdevices.

As illustrated in FIG. 1B, it is also possible that the multi-mediaplatform 108 can be responsible for playing back the media content asdefined by the playback control channel and play the live media streamat the same time as instructed by the encoded markers in the playbackcontrol channel and multiplexing the sources of media. The collaborationcomponent 112 can then stream a combined stream to the audience memberclient devices 110 for playback for the benefit of the audience member.

When the multi-media platform 108 is responsible for the multiplexing ofthe sources as illustrated in FIG. 1B, the present technology stillprovides higher quality media than multiplexing everything at the hostcomputing device 102. When multiplexing happens at the multi-mediaplatform, the quality of media content is limited by the networkbandwidth between the multi-media platform and the audience memberclient device. But when multiplexing happens on the client device of thehost, the quality of media content is limited by the subscription of thehost, and bandwidth between the client device of the host and themulti-media platform, and the bandwidth between the multi-media platformand the audience member client device. At each hop, quality can onlydegrade. Additionally, the connection between the client device of thehost and the multi-media platform needs to download and upload mediacontent so it might be the most bandwidth-constrained link. The presenttechnology also provides more efficient use of network bandwidth thanmultiplexing everything at the client device of the host. If therecorded media content and the live media were multiplexed at the clientdevice of the host then the recorded media content would need to bedownloaded to the client device of the host from the multi-mediaplatform before playback. Thereafter, the multiplexed live playbackstream including the recorded media would need to be transmitted back tothe multi-media platform to be distributed to the audience member clientdevices.

In some embodiments, the present technology also supports multiple hostcomputing devices 102 co-hosting a live playback stream. In suchembodiments, the host computing device 102 both provide their own livemedia stream. In some embodiments, the live media streams of themultiple host computing devices 102 are joined by a conferencingservice, such as an audio or video conferencing service, and are joinedinto a single live media stream that is sent to the multi-media platform108. In some embodiments, an additional host can be temporary, such as ashort appearance by a guest host. The possibility of multiple hostcomputing devices 102 is supported in the embodiments illustrated inboth FIG. 1A and FIG. 1B.

In some embodiments, users can apply “mix rules” to be applied during atransition between two songs in a playlist. The mix rules can be definedand included as part of the playback control channel. Users can alsoapply “mix rules” or “filters” to annotate the media (e.g., applyvoiceovers, narratives, etc., in real-time or near real-time as themedia is being streamed). Mix rules can define or control one or moreaspects of the playback of the songs to which they are applied,including, for example, tempo, pitch, sound effects, volume, and fade-inand fade-out times. Mix rules can also assign specific interactivefeatures to portions of the media such that engagement with theinteractive features triggers actions. For example, a mix rule can beassigned to media that allows an artist to be paid or tipped. Mix rulescan be predefined by the user, system generated, or even generated incollaboration with one or more users.

In some implementations, mix rules can be based on the user'sbiometrics, mood, voice, or emotional state analysis. Mix rules can alsobe “crowdsourced.” Crowdsourcing mix rules refers to deriving mix rulesbased on mix information generated by users of the multi-media platform108. Mix rules and mix information are the same type of information(e.g., parameters and values of parameters for modifying and/ormanipulating playback of content items). As used herein, “mixinformation” is used to refer to user-generated mix rules (e.g.,parameters and values specifying the user-generated mix rules) that arereceived or accessed by the media streaming service, and from which “mixrules” can be crowdsourced.

In some embodiments, machine-learning techniques or other data analysistechniques can be used to analyze the media being played back as part ofa live playback stream and gauge the reaction (e.g., explicit orimplicit) of the audience. Insights gained from the data analysistechniques can be surfaced on the host computing device 102 and used bythe host user account to modify the queue of media content for playbackor the live performance based on these insights.

FIG. 2 illustrates an example environment for performing techniquesdescribed herein, according to an embodiment of the present subjectmatter.

In some embodiments, the environment 200 can include a multi-mediaplatform 108, an NFT platform 242, a finance platform 244, and a socialmedia platform 230 and user devices (host computing device 102, audiencemember client device 110, and artist computing device 224). While FIG. 2illustrates these several platforms, it will be appreciated by those ofskill in the art that one or more of these platforms might not be neededto perform some functions supported by the environment illustrated inFIG. 2 . Furthermore, while FIG. 2 illustrates a logical arrangement ofvarious components, e.g., components 202 to 244, that can performvarious respective functions, that the present the present technology isnot limited to the arrangement illustrated. For example, one or moreservices depicted as being part of the finance platform 244 could bepart of the multi-media platform 108. It will also be appreciated bythose of ordinary skill in the art that one or more other platforms orcomponents can exist.

As used herein, a platform can comprise computing components (e.g.,software and a surrounding ecosystem of resources) associated withservice(s) provided by the service provider, e.g. multi-media platform108. The multi-media platform 108 is an entity that is a digital serviceprovider (DSP) hosting media content (e.g., songs, videos, vlogs,podcasts, interviews, mixes of songs such as remixes, covers, playlists,etc. shown in 130) or otherwise making available such media content. Inaddition, the digital service provider may support paymentsfunctionality to allow users of the DSP to pay/rent/use the mediacontent, and also allow DSP to pay third parties (such as right holdersof the media content) for the media content. The multi-media platform108 may store and track use of media content (e.g., in terms ofstreaming count, revenue collected, artist content, engagementstatistics). In some examples, the multi-media platform 108 canconfigure a dashboard using the dashboard component 246 to displaystatistics related to engagement with media content and its usage tousers and/or artists. Such a dashboard can be configurable to the artistor user accessing it. In some examples, the artist can targetmerchandise relevant to the user, e.g., by converting data fromdashboard to a marketplace hosted by the multi-media platform 108 or athird party in a frictionless manner. The multi-media platform 108 mayallow the artist to receive payments instantly for the use of mediacontent. For example, the artist can be paid directly, before makingpayments to publishers or labels. In one implementation, the multi-mediaplatform 108 may configure the platform to allow artists to receive tipsdirectly from the user interface of the multi-media application 106,e.g., directly from streams or marketplace sales. In some examples, themulti-media platform 108 may use data analytics and machine learning topredictively or pre-emptively determine what type of situations arelikely to generate tips and present tipping options accordingly or haveanalytics driven tip suggestions (how much to tip, where to place thetipping button, etc), and even customize sender/recipient tippingprofiles (e.g., identifiers or usernames for P2P platforms, financialservice providers such as account information to encourage tippingbehavior). In one example, the server can determine who the intendedrecipient of the tip should be on a payment transaction such that theright artist (out of all the artists associated with the song—vocalists,musicians etc.) are getting those tips. The recipients can behighlighted using identifiers (e.g., monetary indicator prefixingalphanumeric user name) on social network platforms (“hey send artist $5for our performance tonight”) and/or on the multi-media application 106based on the context of engagement or usage of media content on themusic service.

While the environment 200 also illustrates one example of each of themulti-media platform 108, the NFT platform 242, the finance platform244, the social media platform 230 the host computing device 102, theaudience member client device 110, and the artist computing device 224,it will be appreciated that there can be any number of such platformsand devices. In the case of the platforms and services, each of theserepresents any number of instances of such platforms and services.Likewise, there can be any number devices in any category of userdevices (host computing device 102, audience member client device 110,and artist computing device 224).

In some embodiments, the multi-media platform 108, the NFT platform 242,the finance platform 244, and the social media platform 230 can all beprovided by the same service provider or parent entity. In someembodiments, one or more of the multi-media platform 108, the NFTplatform 242, the finance platform 244, and the social media platform230 can be provided by one or more third-party entities, and thecomponents within the various platforms can interact to take advantageof services provided by other components shown in FIG. 2 by callingapplication programming interfaces (APIs) offered by the components.

The multi-media platform 108 can provide one or more servicessurrounding the streaming, playback, management, sharing, editing (e.g.,mixing and/or remixing media, adding annotations to media), or socialengagement around media content, etc. In some embodiments, the 108 caninclude a media access component 238 that is configured to providefunctionality around the accessing, e.g., browsing, broadcasting,streaming, and playback, of media content such as those media content116 stored at data store 114. While the term streaming is used herein,the provision of media content by the multi-media platform 108 need notconform to any particular data transfer technique or protocol unlessotherwise stated. Furthermore, the multi-media platform 108 includes astreaming user facing service or an artist facing service or a thirdparty (such as a label or publisher) facing service, or a combinationthereof.

In some implementations, media content can be requested by hostcomputing device 102 or artist computing device 224 in advance andcached prior to playback of the media content. In some embodiments, thestreaming and playback of media content can be a social experience thatcan be facilitated by collaboration component 112, which supports socialor collaborative media content experiences, such as social playback,live playback streams, or collaborative media editing. In someembodiments, the collaboration component 112 allows snippets or previewsof the media to be shared with users. In some embodiments, thecollaboration component 112 can also generate data based oncollaboration from users (artists, hosts, audience members, labels etc.)to adjust the shared experience. The collaboration component 112 mayleverage machine learning for its social recommendations, as well ascollaborative playlists, large-scale group chat, and behavior-basedmusic programming, and implement algorithms to help with discovery oflike artists, listeners, or media and to then inform the sharedexperience. The collaboration data includes engagement with a currentplaylist, activities before the current shared experience and even after(e.g., where did a user of an audience member client device navigateafter playing the shared playlist or live playback stream).

The multi-media platform 108 can also include a media editing component240 configured to provide user interfaces and functionality surroundingfunctions to allow users of the multi-media platform 108 to edit mediacontent to make their own versions or remixes of media content. In someembodiments, one way to edit media content is to extract a sample ofmedia content for incorporation into another media content. A mediasamples component 218 can be configured to provide functionality toassist in the creation and management of media content samples. In someembodiments, media samples component 218 can be configured to access alibrary of existing samples. In some embodiments, media samplescomponent 218 can be configured to automatically suggest samples fromselected media content.

In some embodiments, users can apply “mix rules” to be applied during atransition between two songs in a playlist. Users can also apply “mixrules” or “filters” to annotate the media (e.g., apply voiceovers,narratives, etc., in real-time or near real-time as the media is beingstreamed). Mix rules can define or control one or more aspects of theplayback of the songs to which they are applied, including, for example,tempo, pitch, sound effects, volume, and fade-in and fade-out times. Mixrules can also assign specific interactive features to portions of themedia such that engagement with the interactive features triggersactions. For example, a mix rule can be assigned to media that allows anartist to be paid or tipped. Mix rules can be predefined by the user,system generated, or even generated in collaboration with one or moreusers. In some implementations, mix rules can be based on the user'sbiometrics, mood, voice, or emotional state analysis. Mix rules can alsobe “crowdsourced.” Crowdsourcing mix rules refers to deriving mix rulesbased on mix information generated by users of the multi-media platform108. Mix rules and mix information are the same type of information(e.g., parameters and values of parameters for modifying and/ormanipulating playback of content items). As used herein, “mixinformation” is used to refer to user-generated mix rules (e.g.,parameters and values specifying the user-generated mix rules) that arereceived or accessed by the media streaming service, and from which “mixrules” can be crowdsourced.

The context determination component 226 can determine context dataassociated with communications occurring in collaborative experiences onmulti-media platform 108 or communications occurring on social mediaplatform 230 surrounding media content. In some embodiments, the contextdetermination component 226 can determine one or more of a dateassociated with a communication, a time associated with thecommunication, a topic associated with the communication, content of thecommunication, a user preference of a user associated with thecommunication, a customer preference of a customer associated with thecommunication, a communication channel via which the communication wasreceived, a service/platform via which the communication was received,etc. In some embodiments, the context determination component 226 candetermine a date based at least in part on a timestamp associated withthe communication and/or a time based at least in part on a timestampassociated with the communication.

In some embodiments, the context determination component 226 candetermine a user preference (e.g., shopping habits or listeningbehavior) based at least in part on using a user identifier associatedwith the communication to access a user profile of the user profiles232. In some embodiments, the content context determination component226 can determine a user preference based at least in part ondetermining that a user is similar to other users associated with theservice provider (e.g., using a similarity algorithm or the like) ofwhich one or more preferences are known. In some embodiments, thecontext determination component 226 can determine a customer preferencebased at least in part on using a customer identifier associated withthe communication to access a customer profile of the user profiles 232.In some embodiments, the context determination component 226 candetermine a customer preference based at least in part on determiningthat a customer is similar to another one or more customers associatedwith the service provider (e.g., using a similarity algorithm or thelike) of which one or more preferences are known.

In some examples, the context determination component 226 can determinea topic and/or content of the communication based at least in part onanalyzing data associated with a communication (including historicalcommunications and communications received by other similar users and/orcreating a priority tree based on the history of such communications)and information related to the parties (e.g., users and/or customers)involved in the communication. Communications can be received in theform of questions (e.g., “when does this album release?”), requests toadd/change playlists, questions regarding concert details, etc. In someexamples, the context determination component 226 can utilize naturallanguage processing, image processing, and/or other machine-trainedmodels to determine content of the communication. In some examples, thecontext determination component 226 can utilize a classifier or othermodel to determine semantic meaning of the communication and candetermine a topic of the communication based at least in part on such adetermination. In some examples, a communication can be translated intoa particular language for processing and, any responses can betranslated back to the original language associated with the incomingcommunication.

In some examples, the context determination component 226 can determinethat a communication is associated with a temporal expression. In someembodiments, the context determination component 226 can utilize amachine-trained model (e.g., a classifier, etc.) to detect a temporalexpression in the contents of a communication. In some examples,rule-based approaches or probabilistic semantic parsing can be used todetect a temporal expression in a communication. In some embodiments,the context determination component 226 can partition a communicationbased on identified temporal expressions and can model the communicationwith an expression representative of the communication. In someembodiments, a multi-stage pipeline can be used to label and parsecommunications. In some examples, labels can be determined by artificialneural networks, such as transformers, using an information extractionhead. In some examples, parsing can be performed using a rule-basedcontext free grammar (CFG) parser. In some examples, semantic rolelabeling and parsing, such as (text) span labeling or dependencylabeling, can be used to discover the context in a sentence. In someembodiments, techniques described herein can identify labelled spans byfine-tuning the artificial neural networks with an informationextraction head, and parse spans using a rule-based CFG parser. In someembodiments, temporal expressions can be associated with labelsindicating inclusionary or exclusionary preferences. The contextdetermination component 226 can utilize heuristic pragmatics todetermine which preferences to update or keep. In some examples, apreviously presented candidate time can be used as a reference time, anddate and time preferences can be updated independently. In someembodiments, the context determination component 226 can compose one ormore temporal expressions associated with a communication into anaggregated expression, which can be combined with grammar and backedwith logical formalism, to compose a long, complex temporal expression,and which can be used for determining a response and/or otherwisenegotiating time. Such context determination (e.g., of temporalexpressions) can be used to negotiate time, as described herein, whichcan be useful for scheduling or rescheduling appointments, reservations,and/or the like.

Machine learning techniques as described herein can be applied toadditional or alternative implementations beyond the negotiation of timefor scheduling or rescheduling events, appointments, reservations,and/or the like. For instance, in some examples, the contextdetermination component 226 can determine that a communication isassociated with a geographical and/or location-based expression (e.g.,the communication is location-related). As an additional or alternativeexample, in some examples, the context determination component 226 candetermine that a communication is associated with a commercialexpression (e.g., the communication is transaction-related). Asdescribed above with reference to temporal expressions, in someexamples, rule-based approaches or probabilistic semantic parsing can beused to detect such expressions in a communication. In some embodiments,the context determination component 226 can partition a communicationbased on identified commercial expressions and model the communicationwith an expression representative of the communication. As describedabove, in some embodiments, a multi-stage pipeline can be used to labeland parse communications. In some examples, labels can be determined byartificial neural networks, such as transformers, using an informationextraction head. In some examples, parsing can be performed using arule-based CFG parser. In some examples, semantic role labeling andparsing, such as (text) span labeling or dependency labeling, can beused to discover the context of a sentence. In some embodiments,techniques described herein can identify labeled spans by fine-tuningthe artificial neural networks with an information extraction head andparse spans using a rule-based CFG parser.

The machine learning component 228 can be configured to train modelsusing machine-learning mechanisms. For example, a machine-learningmechanism can analyze training data to train a data model that generatesan output, which can be a recommendation, a score, and/or anotherindication. Machine-learning mechanisms can include, but are not limitedto supervised learning algorithms (e.g., artificial neural networks,Bayesian statistics, support vector machines, decision trees,classifiers, k-nearest neighbor, etc.), unsupervised learning algorithms(e.g., artificial neural networks, association rule learning,hierarchical clustering, cluster analysis, etc.), semi-supervisedlearning algorithms, deep learning algorithms, etc.), statisticalmodels, etc. Machine-trained models described above can be generatedand/or trained by the machine learning component 228 and stored for useat run time.

In some embodiments, the machine learning component 228 can utilizestored communication data associated with communications or othercommunications received and/or sent by the multi-media platform 108 astraining data for training, using machine learning, a model fordetermining temporal expressions in communications. Such temporalexpressions can be used for determining recommendations with respect toresponses to communications. In some embodiments, the machine learningcomponent 228 can receive new training data based at least in part onrecommendations previously output by the machine-trained models and canmodify weights or other aspects of the machine-trained models to improvethe accuracy thereof. That is, in some embodiments, communication dataassociated with communications received and/or sent by the multi-mediaplatform 108, recommendations generated based thereon, new product orservice integrations, etc. can be associated with new training datathat, when analyzed by the machine learning component 228, causeimprovements to features associated with the machine-trained models. Assuch, techniques described herein enable such machine-trained models toimprove over time.

In some embodiments, the context determination component 226 can utilizea machine-trained model (e.g., a classifier, a neural network, etc.) todetermine which communication channel(s) and/or platform(s) to routecommunications and apply mix rules. Techniques described herein providesystems and methods for modifying media (e.g., mixing, and/or remixingmusic) within the context of a multi-media platform 108.

In some examples, the multi-media platform 108 includes an artist portaldisplayed via a dashboard component 246. The dashboard component 246 canconfigure a dashboard to display statistics related to engagement withmedia content and its usage by users and/or artists. Such a dashboardcan be configurable to an artist user account or other user. In someexamples, the artist can target merchandise relevant to the user, e.g.,by converting data from the dashboard to an e-commerce service 210. Themulti-media platform 108 may allow the artist to receive paymentsinstantly for the use of media content through integration with paymentprocessing service 220. For example, the artist can be paid directlybefore paying publishers or labels. In some embodiments, the multi-mediaplatform 108 may allow artists to receive tips directly from the userinterface of a multi-media application operating on client devices,e.g., directly from streams or marketplace sales.

In some embodiments, the multi-media platform 108 can generate theconsolidated communication user interface and can send instructions forpresenting the consolidated communication user interface via the hostcomputing device 102 or artist computing device 224. In someembodiments, the multi-media platform 108 can aggregate communicationsand/or other contextual data (e.g., appointments, receipts, feedbackreceived, orders, fulfillment actions, payments, etc.) based at least inpart on such communications and/or other contextual data beingassociated with the same token or identifier. That is, communicationsand/or other contextual data associated with the same token oridentifier can be consolidated into a conversation. Representations ofconversations can be presented via the dashboard component 246.

In some examples, recommendations related to communication channelsand/or platforms for routing communications can be surfaced via theconsolidated communication user interface. In some examples, themulti-media platform 108 can utilize such a recommendation to perform anoperation without input from the host 202 (e.g., automatically). Forinstance, the multi-media platform 108 can send a response via thesecond communication channel and/or second platform without receiving aninstruction to do so from the host 202.

In some embodiments, the multi-media platform 108 can generatepersonalized analytics for users (e.g., here are the top 10 genres and30 songs played most this entire year; or here is what users in SanFrancisco loved as their top 10 songs this year, etc.). The multi-mediaplatform 108 exposes APIs/SDKs to report out what the San Franciscoaudience listens to as music during dinner time or give you thereal-time report of the top 10 songs your city is listening to rightnow; or even offer interactive games. The multi-media platform 108 alsosupports “skins” or user interface themes for user interface so userscan customize how their app looks and other visual features that can beadjusted, audio-adjustment tools (e.g., adjust frequencies, bass,treble, etc.) users can add on to adjust how their music is played, etc.

In some embodiments, the multi-media platform 108 can be associated withone or more data store 114, which can store data including, but notlimited to, user profiles 232, rule(s) 234, and media content 116.

The data store 114 can be configured to store data that is accessible,manageable, and updatable. While, in FIG. 2 , the data store 114 isshown as part of the multi-media platform 108, this may just be alogical association. The data store 114 can be located in any datacenter and can be accessible to the multi-media platform 108. The datastore 114 can comprise multiple databases and/or servers connected viathe network 216.

The network 216 can be one or more networks including a local areanetwork, or wide area network, and can be a public network or a privatenetwork. The network 216 can utilize any type of communicationtechnology including wired or wireless communications, tunnels, VPNs,etc. The network may be an ad hoc network that is instantiated betweentwo or more devices as needed or can be an infrastructure network thatis persistently available to devices. The network 216 can connect any ofthe devices and platforms illustrated in FIG. 2 . For example, thenetwork 216 can connect host computing device 102, audience memberclient device 110, and artist computing device 224 together in apeer-to-peer network or can connect these devices through a service orplatform such as multi-media platform 108 or social media platform 230.

The network 216 can also connect various components within a platform,such as multi-media platform 108 with other services provided by theplatform. For example, the media access component 238 can be connectedto data store 114 via network 216, and the media samples component 218can be connected to media content value component 204 via network 216,etc.

In some embodiments, the data store 114 can store user profiles 232. Theuser profiles can store information pertaining to user accounts of themulti-media platform 108. In some embodiments, some user accounts canpertain to artists whose media content are accessible through themulti-media platform 108. In some embodiments, artist user accounts canbe associated with additional privileges as compared to general useraccounts. In such instances, the artist user accounts can be verifiedthat the artist account is associated with one or more media contentaccessible through the multi-media platform 108.

The user profiles 232 can store preference information and conclusionsdrawn by context determination component 226 as addressed above.

The user profiles 232 can also store permissions associated with theuser account. The permissions can indicate which users are permitted tosend and/or receive communications. In some examples, such permissionscan be particular to an individual user, a user, a title or roleassociated with a user (e.g., digital rights associated with a title ofartist, label, publisher, or the like). In some examples, permissionscan be particular to device codes (e.g., codes provisioned to users togrant temporary access to a functionality). The permissions can providesecurity and/or access control to individual communications. That is, insome examples, the permissions can enable the multi-media platform 108to selectively present communications to certain users while restrictingaccess of other users to certain communications. In some examples, themulti-media platform 108 can utilize the permissions to restrict howusers are able to interact and/or respond to communications, and/oraccess media. In some embodiments, permissions can be set via a settingsuser interface.

User profiles can store, or otherwise be associated with, dataassociated with users through their user accounts (host user account,artist account, audience member user account). For instance, a userprofile can store, or otherwise be associated with, information about auser (e.g., name of the user, geographic location of the user, operatinghours of the user, streaming statistics, user preferences (e.g., learnedor user-specified), identifier(s) of the user (which can be associatedwith different communication channels and/or platforms), etc.), a usercategory classification (subscriber level, artist level, etc., hardware(e.g., device type) used by the user, transaction data associated withthe user (e.g., transactions conducted by the user, payment dataassociated with the transactions, items associated with thetransactions, descriptions of items associated with the transactions,itemized and/or total spends of each of the transactions, parties to thetransactions, dates, times, and/or locations associated with thetransactions, etc.), loan information associated with the user (e.g.,previous loans made to the user, previous defaults on said loans, etc.),risk information associated with the user (e.g., indications of risk,instances of fraud, chargebacks, etc.), appointments information (e.g.,previous appointments, upcoming (scheduled) appointments, timing ofappointments, lengths of appointments, etc.), payroll information (e.g.,employees, payroll frequency, payroll amounts, etc.), employeeinformation, reservations data (e.g., previous reservations, upcoming(scheduled) reservations, interactions associated with suchreservations, etc.), inventory data, customer service data, messagingdata, etc. A user profile can securely store bank account information asprovided by the user. In some examples, a user profile can include userpreferences with respect to which communication channel(s) and/orplatform(s) they prefer to use for communication, which identifier(s)associated with communication channel(s) they prefer to use forcommunication, etc. In some examples, historical communication dataassociated with a user (e.g., communications sent, communicationsreceived, responses, response time, etc.) can be associated with a userprofile.

User profiles 232 can store user data including, but not limited to,user information (e.g., name, phone number, address, bankinginformation, identifier(s) (e.g., associated with differentcommunication channels and/or platforms), etc.), user preferences (e.g.,learned or customer-specified), purchase history data (e.g., identifyingone or more items purchased (and respective content information),payment instruments used to purchase one or more items, returnsassociated with one or more orders, statuses of one or more orders(e.g., preparing, packaging, in transit, delivered, etc.), etc.),appointments data (e.g., previous appointments, upcoming (scheduled)appointments, timing of appointments, lengths of appointments, etc.),payroll data (e.g., employers, payroll frequency, payroll amounts,etc.), reservations data (e.g., previous reservations, upcoming(scheduled) reservations, reservation duration, interactions associatedwith such reservations, etc.), inventory data, customer service data,messaging data, etc. In some examples, a user profile can include userpreferences with respect to which communication channel(s) and/orplatform(s) they prefer to use for communication, which identifier(s)associated with communication channel(s) they prefer to use forcommunication, etc. In some examples, historical communication dataassociated with a user (e.g., communications sent, communicationsreceived, responses, response time, etc.) can be associated with a userprofile.

The platforms multi-media platform 108, social media platform 230, NFTplatform 242, and finance platform 244 in the environment illustrated inFIG. 2 exist to provide one or more services to users of theseplatforms. Most often the users of the platforms will have a useraccount with one or more of these services. The users illustrated inFIG. 2 will be addressed in the context of multi-media platform 108wherein most often the users will have a user account with multi-mediaplatform 108. However, it should be appreciated that the multi-mediaplatform 108 can support some embodiments wherein a user might not havean account with the multi-media platform 108.

As illustrated in FIG. 2 , users can have one or several roles in thecontext of the multi-media platform 108. Users take a role of anaudience member 236, a host 202, and/or an artist 222. None of the userroles (e.g., host 202, audience member 236, or artist 222) are mutuallyexclusive. Any user of the multi-media platform 108 can take on one ormore of these user roles according to the context in which the user isengaging with the multi-media platform 108. In this way the role isdynamic and in one implementation, can even change within the context ofa single communication between a host and audience member.

FIG. 2 also shows the users being associated with respective clientdevices. The host 202 is associated with a host computing device 102,the artist 222 is associated with an artist computing device 224, andthe audience member 236 is associated with an audience member clientdevice 110. While different devices (e.g., host computing device 102,artist computing device 224, and audience member client device 110) areseparately illustrated, the devices are not necessarily distinct. Theycan all run the same version of a multi-media application that isassociated with the multi-media platform 108 (or any other applicationprovided by any of the other platforms), and all include the samefunctionality when their respective user controls the devices to engagein such functionality. Accordingly, a device that is a host computingdevice 102 in one context can be an artist computing device 224 oraudience member client device 110 in another context.

The multi-media application can be used to send and/or receivecommunications. Such communications can include text communications,email communications, social media communications, first-partyapplication communications (e.g., communications exchanged via anapplication associated with the multi-media platform 108), third partyapplication communications (e.g., communications exchanged via anapplication associated with a party other than the multi-media platform108 and accessible through one or more dedicated API connection points),payments, requests to change playlists or performance, etc.

The host computing device 102, audience member client device 110, andthe artist computing devices 224 can be any type of computing devicesuch as a tablet computing device, a smart phone or mobile communicationdevice, a laptop, a netbook or other portable computer or semi-portablecomputer, a desktop computing device, a terminal computing device orother semi-stationary or stationary computing device, a dedicateddevice, a wearable computing device or other body-mounted computingdevice, an augmented reality device, a virtual reality device, anInternet of Things (IoT) device, etc.

Most often users will interact with the multi-media platform 108 in thecontext of an audience member 236. An audience member 236 is a user thatis consuming services of multi-media platform 108 to receive mediacontent for playback or their own editing of media content.

In some embodiments, a user account can host a collaborative mediaexperience or a public playback experience. In a collaborative mediaexperience, a host can engage with one or more other specific useraccounts through collaboration component 112 to jointly control playbackor editing of media content. In a public playback experience or moreuser accounts acting as a host 202 can host a playback experience thatuser accounts acting as audience members can join to experience theplayback led by the host 202.

Hosts 202 can leverage machine learning for social recommendations, aswell as collaborative playlists, large-scale group chat, andbehavior-based music programming, and implement algorithms to help findpeople who are listening to the same media as host 202. In someimplementations, the media may have digital rights that restrict theplayback of media on third-party platforms where the playlist wasshared. In some embodiments, the collaboration component 112 allowsdigital rights to be conditionally/provisionally shared with otherusers, even if they are not subscribers of multi-media platform 108. Inanother example, collaboration component 112 allows digital rights oridentity verification can be obtained via friction-less onboarding ofthe users onto the multi-media platform 108, for example, viathird-party platform credentials, or phone number, linked paymentinformation and the like.

The collaboration component 112 allows the users to experience the sameplayback of a media content as that of the host 202 through liveplayback streams. In some cases, the multi-media platform 108 mayattribute playbacks of a media content included in a live playbackstream hosted by host 202 as being attributed to the user account ofhost 202 to maintain an accurate accounting of playbacks of the mediacontent. For example, if 10 audience members are listening to a mediacontent instance included in the live playback stream hosted by host202, the media service may count 11 playbacks of the media content andattribute it to originating from host 202.

In the context of sharing, the collaboration component 112 allowsstreaming users, such host 202, artist 222, to share the media contentthey are currently experiencing (listening to or watching) with otherusers (e.g., audience member 236). Users who are connected to thechannel or following host 202 or users with whom host 202 shares theplaylist (e.g., on the same media content supported by multi-mediaplatform 108) can experience the playlist in a manner same as or similarto the host 202. For example, the audience member 236 can listen to thesame song the host 202 is listening to and synced at the exact moment ofsong/cadence or structure of the song, or follow along as the host 202skips or interacts with the song. In this manner, the media content iseffectively synced with all instances where the media content isplaying, or alternatively the media content is synched with respect toone user such that any other audience member 236 joining in the playlistis synced to the moment user host 202 is experiencing. This kind ofcollaborative streaming may leverage machine learning for its socialrecommendations, as well as collaborative playlists, large-scale groupchat, and behavior-based music programming, and implement algorithms tohelp you find people who are listening to the same media that the userhost 202 is. In some implementations, the media may have digital rightsthat restrict the playback of media on third-party platforms where theplaylist was shared. In one example, the collaboration component 119allows digital rights to be conditionally/provisionally shared withother users, even if they are not subscribers of multi-media platform108. In another example, collaboration component 112 allows digitalrights or identity verification can be obtained via friction-lessonboarding of the users onto the multi-media platform 108, for example,via third-party platform credentials, or phone number, linked paymentinformation and the like. In one example, the collaboration component112 allows snippets or previews of the media to be shared with audiencemember 236. In yet another example, the collaboration component 112allows the audience member 236 to be synced to the same instance of thesong that the host 202 is listening to, thus allowing digital rights tobe managed only once, i.e., with respect to the usage of host 202. Insome cases, the media service may attribute audience member 236 of host202 listening to the song and streaming count as host 202's thus if 10connected users are listening to the song instance of host 202, themedia service may count it as 11 counts of streaming and attribute it tooriginating from the host computing device 102.

The collaboration data includes engagement with the current playlist,activities before the current shared experience and even after (e.g.,where did they go after playing the playlist). For example, based onreal-time or near-real time engagement to the experience, audiencemember 236 or if the sharing user is host 202, modify the playlist. Thedata can also reflect segmentation of data, demographics, location,etc., to better customize the playlist. Such data can also be used totrain machine learning models, to allow users, such as artists, to gettipped and paid in real time, get feedback in real time or near realtime on media or portions of media or playlists, generate customized fanexperiences based on the collaboration data. In some aspects thefeedback can be multi-way to allow the customer audience member 236 tosend a communication to a host 202 or artist 222 via computing devicesand receive response. In at least one example, the audience memberclient device 110 can send a communication to the host computing device102 or the artist computing device 224 via the multi-media platform 108or social media platform 230. In some examples, the audience memberclient device 110 can send a communication to the host computing device102 or the artist computing device 224 directly. In at least oneexample, the communication can be associated with a user identifieridentifying the user and a customer identifier identifying the customer.In some examples, the customer identifier can be a device identifier orthe like. In some examples, the customer identifier can be particular tothe type of communication channel through which the communication istransmitted (e.g., a customer identifier can be a phone number if thecommunication channel is a text communication, an email address if thecommunication channel is an email, etc.). In at least one example, thecommunication can be sent via a first communication channel, which cancomprise a text communication, an email communication, a communicationsent via a first-party application, a communication sent via athird-party application, a social media communication, and/or the like.“Communications,” as used herein, can refer to any object, which can beassociated with textual elements, graphical elements, image elements,video elements, sound elements, and/or the like, that can be transmittedvia a communication channel. In some examples, communications can beassociated with attachments, coupons, and/or embedded functionality(e.g., deeplinks, hyperlinks, payment links, etc.). While not describedin detail, in at least one example, the audience member client device110 or host computing device 102 can initiate a conversation via a phonecall. In some examples, the audience member client device 110 or thehost computing device 102 can initiate the conversation via a firstplatform associated with a first service, such as a feedback service, apayment service, a fan experience service (offer a limited editionmerchandise, provide a preview to an unreleased song/or the like) etc.,as described above.

In some embodiments, a host 202 can operate a computing device, such asa host computing device 102, to utilize services offered by themulti-media platform 108. While a single host 202 is illustrated, anynumber of users can be present in the environment.

In some embodiments, one or more artists 222 (also referred to as artistaccount), such as an artist 222, can operate respective computingdevices, such as an artist computing device 224. Artist accounts can beendowed with additional privileges beyond that of an audience member 236or host 202. For example, an artist account may have privileges tointeract with audience member 236 that are fans of an artist account,and may also be able to access statistics related to the accessing ofmedia content for which their user artist account is an attributedartist.

Artist accounts can also receive data to help build their brand or tomake additional revenue. Data gathered by context determinationcomponent 226, context determination component 226, and machine learningcomponent 228 can be used to train machine learning models, to allowusers, such as artists, to get tipped and paid in real-time, getfeedback in real-time or near real-time on media or portions of media orplaylists, generate customized fan experiences based on thecollaboration data. In some aspects, the feedback can be multi-way toallow the artist 222 to send a communication to an audience member 236and receive a response. In some embodiments, these communications can besupported by the multi-media platform 108 or the social media platform230.

In addition, the multi-media platform 108 may support paymentsfunctionality to pay artist accounts to allow users of the multi-mediaplatform 108 to pay/rent/use the media content and allow multi-mediaplatform 108. The multi-media platform 108 may store and track the useof media content (e.g., in terms of streaming count, revenue collected,artist content, engagement statistics).

In some examples, the multi-media platform 108 may use data analyticsand machine learning to predictively or preemptively determine what typeof situations are likely to generate tips and present tipping optionsaccordingly or have analytics-driven tip suggestions (how much to tip,where to place the tipping button, etc.), and even customizesender/recipient tipping profiles (e.g., $cashtags or usernames for peerto peer payment platforms, financial service providers such as accountinformation to encourage tipping behavior). In some embodiments, themulti-media platform 108 can determine who the intended recipient of thetip should be on a payment transaction such that the right artist (outof all the artists associated with the song—vocalists, musicians, etc.)are getting those tips. The recipients can be highlighted using$cashtags on social network platforms (“hey send artist $5 for ourperformance tonight”) and/or on the multi-media application based on thecontext of engagement or usage of media content on the music service.

FIG. 2 also illustrates platforms that can provide services that areancillary to the services of the multi-media platform 108. While theseplatforms are illustrated as separate from the 108, these platforms canbe part of the multi-media platform 108, or one or more of thecomponents of these platforms can be included in the multi-mediaplatform 108.

In some embodiments, the system illustrated FIG. 2 is under themanagement of a common service provider as that of the multi-mediaplatform 108. In some embodiments, the components of the systemillustrated in FIG. 2 can be under the management of several differentthird-party service providers. Each of the components may be accessibleto each other through one or more APIs. Regardless of whether thecomponents illustrated in FIG. 2 are under the management of a commonparty or third parties, each of the components illustrated in FIG. 2 maycommunicate with any other component illustrated in FIG. 2 to provideone or more of the functions addressed herein.

The finance platform 244 can provide one or more financial-relatedservices. For example, the 244 includes a financing engine 214configured to provide financing such as loans or advances to artistaccounts so that the artist accounts may use the financing to createadditional media content and or produce experiences or merchandise forpurchase by other users of the multi-media platform 108. In someembodiments, the financing engine 214 is configured to work with otherservices illustrated in FIG. 2 to generate financing terms. In someembodiments, the financing terms are based on expected revenues fromsales of media content, performances of media content, sales ofmerchandise in e-commerce service 210, licensing of media contentthrough sales of non-fungible tokens (NFT), etc. In some embodiments,the financing engine 214 is also configured to work with a paymentprocessing service to extract a portion of payments received by anartist account, thereby allowing the artist account having financingfrom financing engines to repay the financing.

In some embodiments, artist accounts may be associated with anE-commerce web page offered by e-commerce service 210 that can offermerchandise and experiences for sales to other user accounts ofmulti-media platform 108. The payment processing service 220 can providepayment processing for carrying out transactions by the e-commerceservice 210 and multi-media platform 108.

The payment processing service 220 can also be configured to payroyalties to artist accounts wherein the royalties are associated withthe playback of media content associated with the artist account.

The environment illustrated in FIG. 2 also includes the NFT platform 242for supporting services associated with offering media content andmerchandise as a non-fungible token (NFT). In some embodiments, theartist accounts may elect to embody the value of one or more of theirmedia content in a non-fungible token. “Non-fungibility” refers to theuniqueness or non-interchangeability of individual units of an asset.For example, NFTs cannot be replaced with other tokens of the same type.An example format for an NFT on the Ethereum blockchain is a tokenstandard referred to as ERC-721. The ERC-1155 standard offerssemi-fungibility. Unlike ERC-721, where the unique identifier representsone asset, the unique identifier of the ERC-1155 token represents awhole class of fungible assets, any number of which the user cantransfer to others. Components based on the ERC-998 standard are thetemplates according to which NFTs can be either non-fungible or fungibleassets. While Ethereum is a popular choice for NFT marketplaces, thereare non-Ethereum NFT marketplaces as well, belonging to other blockchainnetworks like Cosmos, Polkadot, International Blockchain Consulting(IBC), Interledger, Binance Smart Chain, etc. Each of the NFTmarketplaces operates slightly differently and has its specificinstructions, standards, formats, and/or the like. For example, some ofthe NFTs are curated while others are self-service based. Creating NFTson some platforms have substantial transaction fees to mint, while somemarketplaces do not support specific file formats or sizes of assets.Some platforms are user-friendly, while others have a complex userinterface that takes significant training.

The NFT component 206 can be configured to generate (or mint) an NFT forone or more media content in near real time, according to user'spreferences (e.g., specific blockchain, expiration time, user'spreferences, user's location (e.g., if it is detected that a user isoperating in a wallet on a different blockchain) and the context of theconversation (or live media content) between the host and the audiencemember. The NFT component 206 can be configured to capture a uniquedescription of the media content and/or to provide a persistent link orreference to the media content associated with the NFT. The NFTcomponent 206 can also be used to create a smart contract used to governthe behavior of the NFT. For example, a smart contract can governinstances when the NFT can be transferred to another party or when amedia content can be divided into a smaller portion such as a sample, orwhen and how the media content can be performed.

When the NFT includes a smart contract chaincode, (e.g., such as systemchaincode available in Hyperledger Fabric 1.0), the governing of thesmart contract can be provided by the smart contract arbiter component212. The smart contract arbiter component 212 can be used to determinethat one or more conditions referenced in a smart contract have beensatisfied. The smart contract arbiter component 212 can otherwise beconfigured to interpret and execute the code defining a smart contract.Through a plurality of smart contracts or chain code, the distributedledger 208 can maintain a consensus between different blockchains withrelation to user's wallets and underlying NFTs, route an incomingtransaction to one of the blockchain(s), e.g., based on context data,and then enable processing of the transaction on the blockchain.

The distributed ledger 208 is configured to store NFTs. In someembodiments, the distributed ledger 208 can be a blockchain network,particularly a blockchain network that supports smart contracts. Onesuch blockchain network is the ETHEREUM network.

In some embodiments, the present technology includes creating andmaintaining a datastore for the media content (and related digitalrights such as mechanical rights, publisher rights, master rights,synchronization rights, etc., held by one or more parties such aslabels, publishers, artists, etc., parties who have invested in themedia content) and/or a record of interactions with the media content.In some embodiments, such rights are stored in distributed ledger 208and can be associated with an NFT and smart contract.

In some embodiments, media content are amenable to being divided intosmaller components called samples. For example, a sample of a musiccontent might include a portion of the music track, e.g., a shortsegment of the music track or a particular sound extracted from themusic track. The media samples component 218 can be configured todetermine potential portions of a media content that might be have adistinct value. In some embodiments, the media samples component 218utilizes machine learning algorithms trained to identify potentialsamples from a media content. For example, in one implementation, themedia samples component 218 integrates with third party application tomeasure engagement of the media content (and specific portion of themedia content) to then determine value.

In some embodiments, e-commerce service 210 can function as amarketplace for transferring one or more NFTs embodying a value of amedia content. In some embodiments, the media content value component204 can be used to determine a current value or a spot price for a mediacontent or a sample of a media content. In some embodiments, the mediacontent value component 204 utilizes data retrieved from an e-commerceservice 210, multi-media platform 108, social media platform 230, andother sources. In some embodiments, the media content value component204 can also predict a future value of a media content.

The system illustrated in FIG. 2 also includes a social media platform230. The social media platform 230 is configured to facilitate artistaccounts for engaging with fans. In some embodiments, the social mediaplatform 230 is configured to integrate with a variety of existingsocial networks such as FACEBOOK, TWITTER, INSTAGRAM, VRCHAT, TIKTOK,etc. In some embodiments, the social media platform 230 is alsoconfigured to collect data regarding engagement with media content of anartist on one or more social networks.

While not illustrated in FIG. 2 , one or more of the multi-mediaplatform 108, the NFT platform 242, the finance platform 244, and thesocial media platform 230 can also include a gift card service (e.g.,for ordering and/or selling gift cards or other stored value cards), aloyalty service (e.g., for managing loyalty rewards and/or redemptions),an invoice service (e.g., for managing invoices for services renderedand/or goods purchased), an estimate service (e.g., for managingestimates for services to be rendered and/or goods to be purchased), acontracts service (e.g., for managing contracts between the user andother entities), a reservation service (e.g., for managingreservations), a chat service (e.g., for facilitating communicationsbetween the user and other entities), a feedback service (e.g., toreceive feedback about various aspects of a business), a directoryservice (e.g., for maintaining contact information of contacts of theuser), an appointment service (e.g., for managing appointments), apayroll service (e.g., for making payroll payments to workers of theuser), etc.

In some embodiments, individual of the services can be associated withtheir own platforms and, in some examples, can utilize SDKs tocommunicate with centralized communication components described herein.

In some examples, the multi-media platform 108 or social media platform230 can receive a communication. The multi-media platform 108 or socialmedia platform 230 can determine where to route the communication (e.g.,send the communication) based at least in part on the user identifierassociated with the communication. In some examples, the multi-mediaplatform 108 of social media platform 230 can associate a token, orother identifier, with the communication. The token, or otheridentifier, can be associated with the sending entity (e.g., the artist222 and/or artist computing device 224). Messages associated with thesame token, or other identifier, can be consolidated into a conversation(or “transcript”) representative of all communications between theaudience member 236 and the artist 222. In some examples, a conversationcan be threaded such that communications associated with a same customerand/or same event/interaction can be grouped together. In someembodiments, a conversation, as described herein, can be represented ina consolidated communication user interface. In some examples, the mediaaccess component 238 can convert the communication into a “standardizedformat.” The converted communication can be stored (e.g., in the datastore 114) and, in some examples, can be presented via a consolidatedcommunication user interface. In at least one example, the host 202, theartist 222, or the audience member 236 can access the consolidatedcommunication user interface via an application, web browser, or thelike. The media access component 238 can consolidate communicationsreceived by the host 202, the artist 222, or the audience member 236 viadifferent communication channels and/or platforms catered for differentmedia content into a single access point (e.g., the consolidatedcommunication user interface) such that the host 202, the artist 222, orthe audience member 236 can view and/or respond to communications viainteraction with the single access point. In some examples,communications can be arranged by entity (e.g., customer, vendor, etc.),which can be based at least in part on tokens, or other identifiers, asdescribed above. In some examples, communications can be arranged basedon date, time, communication channel, content, rules, and/or the like.In some examples, communications can be arranged based on priority,characteristic(s) of the sender (e.g., customer), etc.

In some examples, the multi-media platform 108 can utilize context datato generate a response or a recommendation for the response or evenprovide an array of responses to choose from. That is, in someembodiments, the multi-media platform 108 can utilize context data togenerate personalized loyalty or rewards, that may or may not besurfaced on a peer-to-peer service associated with multi-media platform108. For example, the multi-media platform 108 can recommend actions toincentivize a user or other users to engage more with the media/contentbased on an audience member 236 attending a virtual or in-person liveexperience(s), their taste in music, shopping, and behavioral habits,and such context data. In some embodiments, based on data pertaining todigital experiences, the in-person experience can be configured toengage more with “loyal” users. An artist can provide personalizedexperiences for “true” fans (e.g., shout outs) or on a digital platform,surface true fans on an online list. “Fandom” can be determined based onthe engagement with media, how many times the user has engaged with thecontent, previous live streams, offline streams, downloads, recordcatalog that shows the details, NFT purchases, how many times they havetipped, how many times they have shared the content, the merchandisethat they have purchased, etc. Such data can be obtained via multi-mediaplatform 108 and/or social media platform 230.

In some examples, the multi-media platform 108 can be used to see wholeaves, who engages with data, and who the loyal users are that are morelikely to invest in the content. Such data of loyal users can besurfaced to the artists targeted with customized offers. As someexamples, the loyal users can be targeted with custom rewards, e.g.,specific coupons to use on artist merchandise, or an offer to havedirect follower/fan interaction using live chats, post-promotion videos,etc., or other social networking capabilities through the marketplace orotherwise. In some cases a loyal user may be offered augmented realityobjects to scan, e.g., in concert venues, to get fan interaction offerssuch as limited edition merchandise, merchandise access, reservespecific seats, move to the front of the line, meet the artists, passingsync control to the users, etc. A heat map can be generated to showloyal users, new users, and others to adjust the playlists.

In some embodiments, machine-learning techniques can be used to analyzethe media being played at any given moment, gauge the reaction (e.g.,explicit or implicit) of the audience and modify the playlist or audiobased on real-time or near real time audience feedback.

In some embodiments, the multi-media platform 108 can be an open-sourcetoolkit that operates as an SDK to allow developers to build apps ortools that frame over the media service to support music mixing andsharing of live music experiences (e.g., NFL player sharing live whatmusic he is listening to in his locker room to pump up for an upcominggame or country artist sharing live what she listens to as her calm-downmeditative music while she is doing yoga). The multi-media platform 108can offer a first set of built-in filters that a user can apply to musicthey are listening to create a jazzed, club-vibe, meditative, orcover-song version of the music leveraging artificial intelligence andpredictive learning to analyze the notes, tones, frequencies in themusic and apply the type of DJ features real-life DJs would have appliedto songs with similar notes and frequencies. In some embodiments,multi-media platform 108 can present filters for the type of DJing(seaside waves, yoga, club, work concentration) and see how DJs havemixed songs like these with others based on ML and by analyzing theunderlying DSP parameters and comparing to others in that set. Inanother example, multi-media platform 108 picks the “filter” first andthen recommends songs that can be mixed. So if the user is playing anAdele song, and there are 10 inbuilt filters. Each filter is based on AIstudy of thousands of songs. The filter would compare this song and fromthe notes, tones, frequency, and other DSP parameters determine similarsongs or parts of the song and how DJing was applied by a jazz DJ(separate ML training); a pop concert DJ (separate ML model); a rave DJ(separate ML training data set) and apply it accordingly to varioussegments of the song to get the Auto DJ effect, thus creating a filterbank for songs and music.

FIG. 3A, FIG. 3B, FIG. 3C, FIG. 3D, FIG. 3E, and FIG. 3F illustratesaspects of an example method for facilitating a live playback stream bya multi-media platform. Although the example method depicts a particularsequence of operations, the sequence may be altered without departingfrom the scope of the present disclosure. For example, some of theoperations depicted may be performed in parallel or in a differentsequence that does not materially affect the function of the method. Inother examples, different components of an example device or system thatimplements the method may perform functions at substantially the sametime or in a specific sequence. The example method may be described withreference to the environments, architectures and systems described inthe examples herein, although the methods may be implemented in a widevariety of other environments, architectures and systems.

FIG. 3A illustrates an example method for initiating, controlling, andtransmitting the live playback stream. The method illustrated in FIG. 3Areflects a need in the art to allow users and artists to host liveplayback streams, wherein a host user account can provide a public showto playback recorded media content along with live media. In someembodiments, the live media can include a live performance such asproviding commentary. During a live playback stream, a client device ofthe host user account controls public playback of recorded media contentand is a source of live media such as commentary. In some embodiments, alive playback stream can have the format of a radio show transmittedover the Internet.

The present technology can have several advantages over other liveperformances transmitted over the Internet. In some embodiments, thepresent technology provides the presentation of high-quality recordedmedia content to audience member client device. In another example, thepresent technology can also result in more efficient usage of networkresources. In yet another example, the present technology canautomatically address copyright concerns associated with publicpresentations of recorded media content.

The present technology exists in a context of a multi-media platformwherein media content are stored in a data center and are available forstreaming or download to client devices. In this context, a liveplayback stream that includes playback of recorded media content andlive media presents a particular technological challenge. Specifically,a technological challenge is posed by multiplexing playback of recordedmedia content from a first source with the live media from a secondsource.

In some embodiments, the recorded media content are configured to bedownloaded by an audience member client device and played back locallyon the audience member client device. Meanwhile, the live media isrecorded by the client device of the host and needs to be transmitted tothe audience member client device. In some embodiments, the presenttechnology utilizes an alternative infrastructure, such as utilizing aserver to playback the recorded media content and using the server tomultiplex live media received from the client device of the host andstreaming the pre-multiplexed live playback stream to audience memberclient device.

While technologically challenging, the present technology provides someadvantages. When the multiplexing takes place at the audience memberclient devices, the present technology provides for higher quality mediacontent playback than if the media content were streamed to the audiencemember client device. The present technology can send media content tothe audience member client device prior to playback to be cached,allowing for transmission of higher quality media content. Second, thepresent technology makes more efficient use of network bandwidth. It islikely that one or more media content that are part of the live playbackstream have previously been downloaded and cached by one or moreaudience member client devices. When this occurs, there is no need tore-transmit the media content. Since many people tend to repeatedlyengage in media programming that matches their tastes, it is likely thatsome media content will repeatedly be encountered. Therefore it islikely that some media content that are part of the live playback streamhave already been downloaded and cached by audience member clientdevices.

When the multiplexing takes place at the multi-media platform thepresent technology provides higher quality media than multiplexingeverything at the client device of the host. As addressed above, whenthe multiplexing occurs at the audience member client device, there ispotential that audience member client device can actually receive higherquality media content than experienced by the host. This occurs becauseevery client device could receive the higher quality media content thantheir subscription provides for. When multiplexing happens at themulti-media platform, the quality of media content is limited by thenetwork bandwidth between the multi-media platform and the audiencemember client device. But when multiplexing happens on the client deviceof the host, the quality of media content are limited by thesubscription of the host, and bandwidth between the client device of thehost and the multi-media platform, and the bandwidth between themulti-media platform and the audience member client device. At each hop,quality can only degrade. Additionally, the connection between clientdevice of the host and the multi-media platform needs to download andupload media content so it might be the most bandwidth-constrained link.The present technology also provides more efficient use of networkbandwidth than multiplexing everything at the client device of the host.If the recorded media content and the live media were multiplexed at theclient device of the host then the recorded media content would need tobe downloaded to the client device of the host from the multi-mediaplatform before playback. Thereafter, the multiplexed live playbackstream including the recorded media would need to be transmitted back tothe multi-media platform to be distributed to the audience member clientdevices.

The present technology also addresses the problem of how to synchronizethe playback of the recorded media content with the live media so thatthe two sources can be multiplexed at a location other than the clientdevice of the host that controls the live playback stream.

Techniques described herein provide for sharing media experiences withinthe multi-media platform. In some embodiments, the present technologydisclosed herein includes an infrastructure for users to collaborate onexperiences (such as digital concerts, opining on a podcast innear-real-time, sharing music playlists with friends and family, and soon).

Both of these possible architectures also address common copyrightissues associated with public presentations of recorded media content.In other live performances over the Internet, a performer might playbacka media content on their client device in association with their liveperformance.

However, since the client device is not aware that the recorded mediacontent are being transmitted to other users over the Internet, there isno way for the client device to discern that a different royalty ratesuch as that associated with a public performance of recorded mediacontent should be paid to an artist or recording label. In contrast, thepresent technology is aware of the intent to transmit the recorded mediacontent over the Internet for playback to a public audience since thehost user account declares that intent. Furthermore, the multimediaplatform responsible for broadcasting the live playback stream is thesame platform responsible for providing the media content andmaintaining an accounting for payment of appropriate royalties.Accordingly, the present technology has the benefit that the multimediaplatform can automatically account for the public playback of any mediacontent properly.

These and other advantages will be apparent to those of ordinary skillin the art from the descriptions herein.

According to some examples, the method illustrated in FIG. 3A includesreceiving an instruction to initiate a live playback stream over theInternet at block 302. For example, the collaboration component 112illustrated in FIG. 1A may receive an instruction to initiate a liveplayback stream from a client device of the host user account.

The host user account can be a general user account or can be an artistaccount. An artist account is a user account that has been verified tobe associated with one or more recorded media content available forplayback from the multi-media platform. In contrast, a general useraccount is any user account that is not a verified artist user account.

According to some examples, the method includes initiating at least twostreams between the client device and the multi-media platform at block304. For example, the collaboration component 112 illustrated in FIG. 1Amay initiate at least two streams between the client device and themulti-media platform 108. One stream is a playback control channelbetween the multi-media platform and the client device for transmittingdata regarding playback controls pertaining to recorded media content.Another stream is a live media stream for transmitting data encodinglive commentary.

The playback control channel is a data channel used to transmitinformation including an identification of recorded media content to beplayed back during the live playback stream, playback controls,instructions regarding various effects to be applied to the recordedmedia content during playback, and multiplexing information to be usedto multiplex the live media stream with the playback of the recordedmedia content. The data regarding playback controls of the playbackcontrol channel includes playback synchronization information for theplayback of the recorded media content such as play, skip, and pausecommands. The instructions also provide various effects to be applied tothe recorded media content during playback including data describingcustom multiplexing or transitions to apply to the recorded mediacontent. The multiplexing information maps the audio captured by themicrophone to a time-domain associated with a currently playing recordedmedia content.

The live media stream can include audio or audio-video media of a liveperformance. The data encoding the live commentary in the live mediastream is audio captured by a microphone of the client device. While thelive media stream implies that the live performance is commentary toaccompany the playback of the recorded media content, it is not limitedto commentary. The live media stream can be a recording of any liveperformance.

The live media stream can include encoded markers as reference pointsalong with the live performance recording. The playback control channelcan reference the encoded markers to indicate where that portion of thelive performance corresponds to the playback of the recorded mediacontent.

According to some examples, the method includes receiving dataidentifying media content in at least a portion of an up next queue fromthe client device at block 306. For example, the collaboration component112 illustrated in FIG. 1A may receive data identifying recorded mediacontent in at least a portion of an up next queue from the clientdevice. The up next queue is controlled by the host user account andincludes at least one recorded media content planned for playback duringthe live playback stream.

As will be addressed further below, the host can populate a queue ofrecorded media content for playback during the live playback stream. Therecorded media content in the up next queue can be identified by uniqueidentifiers and meta data describing the title of the media content andthe performing artist.

The collaboration component 112 can receive a list of recorded mediacontent identified by their unique identifiers or other metadata as partof the playback control channel. The collaboration component 112 doesnot need to receive the actual recorded media content from the clientdevice of the host. Instead, the multi-media platform 108 already storesor otherwise has access to the recorded media content. Generally, themulti-media platform 108 also has access to the recorded media contentin its highest quality available as compared to any of the other devices(audience member client devices, host devices, etc.) in the system.

As addressed above, the present technology can be practiced bymultiplexing the playback of the recorded media content and the livemedia on an audience member client device (as illustrated by block 308and block 310) or at the multi-media platform 108 (as illustrated byblock 312 and block 314).

According to some examples, the method includes hosting the liveplayback stream over the Internet by transmitting at least a portion ofthe data from the playback control channel and the live media stream toa connecting client device at block 308. For example, the collaborationcomponent 112 illustrated in FIG. 1A may host the live playback streamover the Internet by transmitting at least a portion of the data fromthe playback control channel and the live media stream to an audiencemember client device.

In embodiments wherein the playback of the recorded media content andthe live media are multiplexed on the audience member client devices,the method includes sending the data identifying recorded media contentat block 310. For example, the collaboration component 112 illustratedin FIG. 1A may send the data identifying recorded media content to theaudience member client devices, whereby the audience member clientdevice can determine whether any of the identified media content arealready stored or cached at the audience member client device, andrequest the media content not stored on the audience member clientdevice from the multi-media service.

The recorded media content can be played back at the audience memberclient device and the live media can be multiplexed using data from theplayback control channel on an instance of the multi-media applicationrunning on an audience member client device of a user account connectedto the live playback stream.

In embodiments wherein the playback of the recorded media content andthe live media are multiplexed at the multi-media platform 108, themethod includes multiplexing audio data for a media content with thelive media, at block 312. For example, the multi-media platform 108illustrated in FIG. 1B may multiplex audio data for a media content withthe live media.

According to some examples, the method includes transmitting a singlecombined media stream including the recorded media content for liveplayback with the live media at block 314. For example, the multi-mediaplatform 108 illustrated in FIG. 1B may transmit a single combined mediastream including the recorded media content for live playback with thelive media.

FIG. 3B illustrates an example method for announcing a live playbackstream and otherwise inviting potential audience members to join thelive playback stream using their client device.

How far a particular user account can reach to invite audience memberscan be a function of whether their account is an artist account or ageneral user account. While all user accounts can access any of theirfollowers in a network of the multi-media platform 108 and any socialmedia accounts that are linked to the multi-media platform 108, onlyartist accounts should be able to reach user accounts (or those withoutuser accounts of the multi-media platform) that are not within theirnetwork. According to some examples, the method includes receiving aninput to send a notification announcing a live playback stream at block316. For example, the context determination component 226 illustrated inFIG. 1A may receive a communication from host computing device 102indicative of a user interface input received by a multi-mediaapplication operating on the host computing device 102 to send anotification announcing a live playback stream. The multi-mediaapplication is associated with the multi-media platform 108.

According to some examples, the method includes sending the notificationannouncing the live playback stream to user accounts that follow theuser account, and over social media channels linked to the user accountat block 318. For example, the collaboration component 112 illustratedin FIG. 1A may send the notification announcing the live playback streamto user accounts that follow the user account, and may sendnotifications over social media channels linked to the user account.While the sending of the notification can be in response to the requestto send the notification illustrated as block 316, the sending of thenotification can also occur automatically after a user account sends theinstruction to initiate the live playback stream at block 302.

In some embodiments, the multi-media platform 108 can maintain its ownsocial features, such as the ability to follow certain user accounts tobe notified when they begin a live playback stream or to receiveinformation or notifications about posts from certain user accounts.Thus, when a host user account initiates a live playback stream, themulti-media platform 108 can notify user accounts that have a socialconnection or followers on the multi-media platform. Additionally, themulti-media platform 108 can be linked to other social networks andthird party platforms, such as FACEBOOK, INSTAGRAM, TWITTER, TICKTOCK,YOUTUBE, DISCORD, VRCHAT, REC ROOM, HORIZONS, etc., and can sendmessages through linked user accounts on these platforms utilizing oneor more APIs provided by the social media networks.

Additionally, a user account that is about to initiate a live playbackstream can also invite users. According to some examples, the methodincludes receiving an identification of specified user account(s) tojoin the live playback stream at block 320. For example, the multi-mediaplatform 108 illustrated in FIG. 1A may receive an identification ofspecified user account(s) to invite to the live playback stream.According to some examples, the method includes inviting the specifieduser account(s) to connect to the live playback stream at block 322. Forexample, the multi-media platform 108 illustrated in FIG. 1A may invitethe specified user account(s) to connect to the live playback stream.

As noted above, an artist account may be able to reach potentialaudience members that are outside their social network or that have nototherwise followed the artist. In some instances, users of themulti-media platform 108 have a specific interest in being exposed tonew media content and artists, which can be promoted by informing otherusers of instances when an artist account initiates a live playbackstream. Additionally, artists, especially up-and-coming artists have astrong interest in obtaining new fans. To this end, artists may pay forthe service of informing users outside of the artist's social network ofthe live playback stream. In some embodiments, the artist can agree toshare a portion of royalties that come from user accounts that connectto the live playback stream that subsequently playback media contentfrom the artist.

Accordingly, the method illustrated in FIG. 3B can include determiningwhether the user account is one of the verified artist user accounts atdecision block 324. For example, the multi-media platform 108illustrated in FIG. 1A may determine that the user account is one of thegeneral user accounts.

One privilege that can be afforded to an artist account can be reachingnew audience members. According to some examples, the method includesidentifying user accounts whose taste profiles indicate that they mightbe interested in the live playback stream from the artist account atblock 326. For example, the multi-media platform 108 illustrated in FIG.1A may identify user accounts whose taste profiles indicate that theymight be interested in the live playback stream from the artist account.As will be addressed further herein, the multi-media platform 108 canmaintain taste profiles as part of a user profile that indicates artiststhat the user account favors and attributes of media content that theuser account favors.

According to some examples, multi-media platform 108, illustrated inFIG. 1A, may collect information associated with user accounts. Theinformation associated with user accounts can include media contentpreference information, social channel information, and/or purchaseinformation. The media content preference information is derived fromexplicit data provided by user inputs indicating an affinity for anartist or a media content and implicit data such as playback engagementdata, including skip counts, play counts, and purchases. The socialchannel information is received from one or more social platforms andcan include data about social contacts and follower information, topicengagement, and content engagement. The purchase information can bereceived from one or more payment networks indicating spendingpertaining to engagement with media content or artists.

According to some examples, the method includes comparing a mediacontent preference of the user account with other accounts to identifyother accounts with similar media content preferences. The methodfurther includes comparing the media content in the queue of mediacontent with the media content preferences of other user accounts toidentify other user accounts whose media content preferences indicatethat they would enjoy joining the live playback stream.

The method includes analyzing the information associated with the useraccounts to generate the media content preference information, includingone or more representations of an affinity of a user of a user accountfor a media content. The method further includes analyzing theinformation associated with the user accounts to generate an artistaffinity profile. The artist affinity profile includes a score of anaffinity for a particular artist for a user of a user account.

According to some examples, the multi-media platform 108 illustrated inFIG. 1A may compare scores in the artist affinity profiles in respectiveuser accounts. The multi-media platform 108 may determine user accountsfrom the population of user accounts having the strongest affinity forthe particular artist.

Using this data, the multi-media platform 108 can identify user accountsthat might be interested in the live playback stream hosted by theartist account and can invite these user accounts to join the liveplayback stream. According to some examples, the method includesinviting the user accounts from the population of user accounts havingthe strongest affinity for the particular artist to an event hosted bythe artist.

In some embodiments, the multi-media platform 108 can invite users usingthe techniques addressed above to invite users to live playback streamsand events other than live playback streams. For example, themulti-media platform 108 can invite users to an event hosted by theartist, such as a live chat or video conference. In some embodiments,the event can occur outside of the multi-media platform, such as asocial media platform, video conferencing platform, chat platform, etc.

In some embodiments, a live playback stream may have more than one host.A host can be any user account that can at least have some control overthe media content to be played during the live playback stream and/orcan join in the live performance portion of the live playback stream. Insome implementations, identification of the host is based on themetadata, e.g., artist name, of the media content, and/or the sequencein which the media content is played. Further, the host may beassociated with specific access levels (e.g., verified status, oridentity verification) to be able to host. In such implementations of aplurality of hosts, the switching of control from one host to another ina seamless manner without any user intervention. In case of shuffling orotherwise change in sequence, the control automatically changes.

The method illustrated in FIG. 3C can be performed at any time duringthe live playback stream.

According to some examples, the method includes receiving a request tojoin the live playback stream as a secondary host at block 328. Forexample, the collaboration component 112 illustrated in FIG. 1A mayreceive a request to join the live playback stream as a secondary host.The request to join the live playback stream as the secondary host caninclude a token identifying the live playback steam and a rights objectissued by either the client device of a primary host (when the primaryhost invites the secondary host) of the live playback stream or themulti-media platform 108 (such as when the primary host and thesecondary host are preconfigured prior to initiation of the liveplayback stream).

According to some examples, the method includes initiating a secondaryhost live media stream with the secondary host at block 330. Forexample, the collaboration component 112 illustrated in FIG. 1A mayinitiate a secondary host live media stream with the secondary host.

The secondary host live media stream is an additional live media streamthat is the same as described with respect to FIG. 3A for the primaryhost and can be multiplexed into the live playback stream in the samemanner. One difference, however, is that the secondary host live mediastream also needs to be transmitted to the primary host client device sothat they can hear the audio of their co-host. According to someexamples, the method includes receiving commentary from the secondaryhost and transmitting it to the primary host and to the audience memberclient device at block 332. For example, the collaboration component 112illustrated in FIG. 1A may receive commentary from the secondary hostand transmit it to the primary host and to the audience member clientdevices.

Alternatively, rather than utilizing multiple live media streams, theprimary host and the secondary host can be joined in a video or audioconference using a conferencing service, and the conferencing servicecan transmit a single live media stream.

In some embodiments, the secondary host may be a guest host joining thelive playback stream for a short interval. The secondary host might alsobe one of the users of one of the audience member client devices thathas been invited to be a secondary host for a brief interval, much likea call-in listener on a radio program. In such instances, the primaryhost may limit the privileges of a secondary host, such as limiting thesecondary host to only providing commentary as part of the liveperformance, and the primary host can terminate the secondary hostprivileges.

According to some examples, the method includes receiving an instructionfrom the primary host to terminate the secondary host live media streamat block 334. For example, the collaboration component 112 illustratedin FIG. 1A may receive an instruction from the primary host to terminatethe secondary host live media stream.

In some embodiments, one or more hosts (the primary host or secondaryhosts) might be associated with some of the recorded media content inthe live playback queue. For example, one or more of the hosts mighthave added the recorded media content to the live playback queue or oneor more of the hosts might be an artist that performs the recorded mediacontent in the playback queue. In such embodiments, the collaborationcomponent 112 can assist in coordinating the multiple hosts. Forexample, the collaboration component 112 can determine whether one ofthe hosts are associated with the next recorded media content in theplayback queue at decision block 336. When collaboration component 112determines that one of the hosts is associated with the next recordedmedia content, the collaboration component 112 can temporarily providethat host control over the live playback stream so that the host cancontrol the live media stream and/or control the effects andmultiplexing of the recorded media content. In some implementations, thecollaboration component 112, using machine learning, identifies portionof the recorded media where another host, primary or secondary, to whomthe control is transferred may provide recorded media. Accordingly, thecollaboration component 112 can create placeholders for the hosts toprovide commentary. If the hosts provide live media, e.g., commentary,the live media is multiplexed with the recorded media in the predefinedtimestamp, however if the hosts do not provide live media, theplaceholders are removed so that there is no lag from an audience'sperspective.

The temporary control can take the form of temporarily granting asecondary host one or more privileges of a primary host. The temporarycontrol can take the form of allowing the host associated with the nextmedia content control over whether other hosts can transmit over thelive media stream, and controlling certain instructions that can betransmitted over the playback control channel.

In some embodiments, it may be desirable to provide information or alink to an audience member client device for display in the multi-mediaapplication as their users are consuming a live playback stream.

Such embodiments can be desirable when a host of the live playbackstream has a website that they use to sell merchandise. This can beprevalent with artist accounts that have recorded media content,tickets, and other merchandise to sell. However, even general useraccounts hosting live playback streams can have websites that sellmerchandise. A general user account can become popular and may have manyfollowers. In some embodiments, a general user account could become anartist account if the general user account becomes a popular personalityt0 follow on the multi-media platform 108.

According to some examples, the method includes providing at least onecontent for acquisition by a user of the audience member client deviceat block 352. For example, the multi-media platform 108 illustrated inFIG. 1A may provide at least one content for acquisition by a user ofthe audience member client device. The content for acquisition is to bedisplayed as an actionable link in a user interface at the connectingdevice. The content for acquisition can be an content available from awebpage or online store associated with an artist account or generaluser account. In some embodiments, while a general user account hoststhe live playback stream, the context determination component 226 cancause the multi-media platform 108 to provide a link to an content foracquisition that is sold by another user or even an artist that does nothave an artist account with the multi-media platform 108 when thecontext determination component 226 associates the context of the liveplayback stream with the content for acquisition. The multi-mediaplatform 108 can provide the content for acquisition using the playbackcontrol channel or another communication stream between the multi-mediaplatform 108 and the audience member client devices.

According to some examples, the method includes receiving a request fromthe audience member client device as a result of the actuation of theactionable link by the user of the audience member client device atblock 348. For example, the multi-media platform 108 illustrated in FIG.1A may receive a request from the audience member client device as aresult of the actuation of the actionable link by the user of theaudience member client device.

According to some examples, the method includes redirecting, e.g., usinga URL, scannable code, QR code, other identifier, etc., the audiencemember client device to a landing page associated with the host of thelive playback stream at block 350. For example, the multi-media platform108 illustrated in FIG. 1A may redirect the audience member clientdevice to a landing page, e.g., store page, forum page, web application,concert page, artist website, etc., of the live playback stream host.The store page of the host of the live playback stream includes the atleast one content for acquisition. As noted above, in some embodiments,the store page could also be associated with other user accounts or evenentities that do not have a user account with the multi-media platform108.

In some embodiments, the store page can be hosted by an e-commerceservice. In some embodiments, the e-commerce service can communicatewith the multi-media platform 108. In some embodiments, the e-commerceservice and the multi-media platform 108 can communicate using one ormore APIs. In some embodiments, the e-commerce service and themulti-media platform 108 can be part of a larger entity that can bringtogether e-commerce service functionality and the multi-media platform108 functionality for users of both services as addressed with respectto FIG. 1A. According to some examples, the method includes receivingreporting data from an e-commerce service indicating that the user ofthe audience member client device acquired the at least one content foracquisition at block 346. For example, the multi-media platform 108illustrated in FIG. 1A may receive from an e-commerce service reportingdata indicating that the user of the audience member client deviceacquired the at least one content for acquisition. In some cases, thelanding page can be informational providing the user with informationregarding the media content with no actionable links. In another case,the landing page can be customized based on historical data and contextspecific to the host and the audience member.

In some embodiments, the multi-media platform 108 can automatically beresponsible for providing links to items for acquisition. According tosome examples, the method includes performing machine learning analysis,e.g., natural language processing, on the live media stream at block340. For example, the context determination component 226 illustrated inFIG. 1A may perform natural language processing on the live media streamto interpret a contextual cue that is relevant to one or more items foracquisition.

According to some examples, the method includes detecting a statement inthe live media stream informing the user of the audience member clientdevice of a purchase opportunity at block 342. For example, the contextdetermination component 226 illustrated in FIG. 2 may detect a statementin the live media stream informing the user of the audience memberclient device of a purchase opportunity. For example, a host of the liveplayback stream might make a reference to an upcoming concert, and thecontext determination component 226 can detect the reference to theconcert tickets and can map the reference to concert tickets to ticketsfor purchase that can be provided as the content for acquisition to theconnecting client devices. In another example, the host can refer to arecorded media content and the context determination component 226 candetect this reference and map the reference to the media content at ane-commerce service. In another example, the context determinationcomponent 226 can identify a recorded media content for playback in thelive playback stream and identify an content for acquisition related tothe recorded media content. In some embodiments, the host of the liveplayback stream might not have any relationship with the web page of thee-commerce service. For example, the host could be a general useraccount that has chosen to feature an artist in the live playback streamand the context determination component 226 can cause an content foracquisition to be presented in the multi-media application playing thelive playback stream.

According to some examples, the method includes creating a personalizedlink for providing at least one content for acquisition by a user of theaudience member client device corresponding to the purchase opportunityat block 344. For example, the context determination component 226illustrated in FIG. 2 may provide a link for providing at least onecontent for acquisition by a user of the audience member client devicecorresponding to the purchase opportunity. The at least one content foracquisition can include tickets to a live show, a media content,merchandise, etc. In some implementations where the user providesexplicit authorization, the links may merely serve as notifications andthe item can be automatically purchased on behalf of the audiencemember, e.g., based on audience member's preferences. This can be fortimed events. In some embodiments, the link can be personalized based onattributes of the audience member derived from their user profile,communication between the audience member and the specific artist/host(or like artists/hosts) and/or past transaction behavior. The link orlanding page can be thus modified on a per audience basis such thataudience member A sees option to buy merchandize, whereas audiencemember B sees an option for concert tickets.

According to some examples, the method includes collecting metricsregarding user accounts connected to the live playback stream at block354. For example, the multi-media platform 108 illustrated in FIG. 1Amay collect metrics regarding user accounts connected to the liveplayback stream.

According to some examples, the method includes sending real-timelistener data including at least a user name and at least one statisticregarding engagement by a respective real-time listener to the useraccount controlling the broadcast at block 356. For example, themulti-media platform 108 illustrated in FIG. 1A may send real-timelistener data including at least a user name and at least one statisticregarding engagement by a respective real-time listener to the useraccount controlling the broadcast.

FIG. 3F illustrates an example method of providing differentiated levelsof engagement for some users, especially users that are loyal users.

According to some examples, the method includes determining that thereare different segments of audience members connected to the liveplayback stream including a first segment of user accounts and a secondsegment of user accounts at block 358. For example, the collaborationcomponent 112 illustrated in FIG. 1A may determine that there aredifferent segments of audience members connected to the live playbackstream including the first segment of user accounts and the secondsegment of user accounts.

The second segment of user accounts can be part of a loyal users segmentthat includes top fans of an artist account that is the source of thelive playback stream. A first audience member engagement experienceprovides a first segment of user accounts with limited engagementoptions.

According to some examples, multi-media platform 108 illustrated in FIG.1A may collect information associated with user accounts to identify topfans of an artist account. The information associated with user accountscan include media content preference information, social channelinformation, and/or purchase information. The media content preferenceinformation is derived from explicit data provided by user inputsindicating an affinity for an artist or a media content, and implicitdata such playback engagement data including skip counts, play counts,and purchases. The social channel information is received from one ormore social platforms and can include data about social contacts andfollower information, topic engagement, and content engagement. Thepurchase information can be received from one or more payment networksindicating spending pertaining to engagement with media content orartists. The media content preference information can be used toidentify the loyal users segment of users. A loyal users can be a useraccount that demonstrates a highest affinity for the artist or one ofthe media content performed by the artist. A loyal users can also be auser account that demonstrates the highest level of engagement with anartist by joining the most live playback streams, buying the mostmerchandise, or hosting their own live playback streams that feature theartist.

According to some examples, the method includes inviting users to asecond audience member engagement experience hosted by the artistaccount at block 360. For example, the collaboration component 112illustrated in FIG. 1A may invite loyal users users to the secondaudience member engagement experience hosted by the artist account.

The second audience member engagement experience can be an enhancedengagement experience reserved for a limited number of loyal users. Insome embodiments, the top loyal users connected to the live playbackstream can be segmented out and provided the invitation to the secondaudience member engagement experience.

When the event is a second audience member engagement experienceassociated with a live playback stream, the invited fans might be givenaccess to a live chat with the artist account or might be granted atemporary privilege as a secondary host.

In some embodiments, the invitation can include a security token toensure that only the invited user account can join the event. In someembodiments, the event is a second audience member engagement experienceassociated with a live playback stream. The different segments of theaudience members are connected to different instances of the liveperformance of the broadcast.

According to some examples, the method includes receiving a request toaccess the second audience member engagement experience at block 362.For example, the collaboration component 112 illustrated in FIG. 1A mayreceive a request to access the second audience member engagementexperience.

According to some examples, the method includes determining whether therequest includes evidence of a received security token at block 364. Forexample, the collaboration component 112 illustrated in FIG. 1A maydetermine whether the request includes evidence of a received securitytoken. The security token can be used to ensure that any invitations arenot shared outside of the user account that has been invited to theevent.

According to some examples, the method includes sending a pushnotification to a multi-factor authentication (MFA) component to providesecondary authentication of the user account prior to allowing the useraccess to the event at block 366. For example, the collaborationcomponent 112 illustrated in FIG. 1A may send a push notification to aMFA component to provide secondary authentication of the user accountprior to allowing the user access to the event.

According to some examples, the method includes receiving acommunication from one of the audience members connected to the secondinstance of the live playback stream at block 368. For example, thecollaboration component 112 illustrated in FIG. 1A may receive acommunication from one of the audience members connected to the secondinstance of the live playback stream providing the second audiencemember engagement experience.

According to some examples, the method includes broadcasting thereceived communication to all other audience members connected to thesecond instance of the live playback stream including a broadcaster thatis the source of the live playback stream at block 370. For example, thecollaboration component 112 illustrated in FIG. 1A may broadcast thereceived communication to all other audience members connected to thesecond instance of the live playback stream including a broadcaster thatis the source of the live playback stream.

FIG. 3G illustrates an example method wherein a machine learningalgorithm can provide suggestions to the host user account during a liveplayback stream in accordance with some aspects of the presenttechnology.

According to some examples, the method includes providing a suggestionprompt to a host user account of the live playback stream to insertcontent at a place in the upcoming live playback stream at block 372.For example, the machine learning component 228 can analyze datapertaining to the media content in the live playback queue and/or datapertaining to user accounts of audience members joined to the liveplayback stream to determine opportunities for the host to insertcontent at a place in the upcoming live playback stream.

For example, the machine learning component 228 can determine that aloyal fan is one of the audience members or that a loyal fan has abirthday or just bought some merchandise from the host, and the machinelearning component 228 can suggest that the host make a shout out to theloyal fan.

In another example, the machine learning component 228 can suggestadvertising an item for acquisition. The machine learning component 228can identify that media content upcoming in the live playback queue isassociated with an artist for which a concert is upcoming and themachine learning component 228 can suggest that the host announce thattickets are available. In some embodiments, the machine learningcomponent 228 can suggest that an electronic advertisement or link bepresented to the audience members.

In another example, the machine learning component 228 can suggestminting an NFT on the NFT platform 242 and offering it as an item foracquisition, or offering some loyalty reward to engage audienceparticipation in the live media stream.

In some embodiments, the suggestion prompt can include a suggested timeto insert commentary or offer an item for acquisition. The suggestedtime could be between playback of particular media content in the liveplayback queue, or even at a timestamp within a media content.

According to some examples, the method further includes determiningwhether the commentary was provided at decision block 374. Themulti-media platform 108 can track whether the commentary was providedin order to control how many prompts are offered in the future and totrack the performance of advertisements made as a result of the prompts.

FIG. 4 illustrates an example method for producing a live playbackstream by a multi-media application associated with a user account of amulti-media service. Although the example method depicts a particularsequence of operations, the sequence may be altered without departingfrom the scope of the present disclosure. For example, some of theoperations depicted may be performed in parallel or in a differentsequence that does not materially affect the function of the method. Inother examples, different components of an example device or system thatimplements the method may perform functions at substantially the sametime or in a specific sequence. The example method may be described withreference to the environments, architectures and systems described inthe examples herein, although the methods may be implemented in a widevariety of other environments, architectures and systems.

According to some examples, the method includes presenting a queue ofrecorded media content and a live playback stream control user interfacebutton in the multi-media application at block 402. For example, themulti-media application executing on host computing device 102 or artistcomputing device 224 illustrated in FIG. 2 may present a queue of mediacontent and a public playback control user interface button in themulti-media application.

In some embodiments, the queue of media content in the multi-mediaapplication is one of at least two different queues. The two differentqueues can include a live playback queue and a personal playback queue.The queue of media content is a list of audio or video media content tobe played. The purpose of two different queues is to allow a host 202 tobe able to playback media content in their personal playback queuewithout interfering with the curation of the live playback queue.

According to some examples, the method includes receiving a selection ofthe public playback control user interface button at block 404. Forexample, the multi-media application executing on host computing device102 or artist computing device 224 illustrated in FIG. 2 may receive aselection of the public playback control user interface button. Thepublic playback control user interface button is configured toreversibly switch between a personalized playback mode and a publicplayback mode.

According to some examples, the method includes switching from thepersonalized playback mode to the public playback mode at block 406. Forexample, the multi-media application executing on host computing device102 or artist computing device 224 illustrated in FIG. 2 may switch fromthe personalized playback mode to the public playback mode in responseto receiving the selection of the public playback control user interfacebutton. In the public playback mode the multi-media application controlspublic playback of media content and a source of live media during thelive playback stream.

According to some examples, the method includes determining that ashuffle option is enabled in the multi-media application at block 408.For example, the multi-media application executing on host computingdevice 102 or artist computing device 224 illustrated in FIG. 2 maydetermine that a shuffle option is enabled in the multi-mediaapplication. According to some examples, the method includes disablingthe shuffle option at block 410. For example, the multi-mediaapplication executing on host computing device 102 or artist computingdevice 224 illustrated in FIG. 2 may disable the shuffle option. Inembodiments where two queues exist, the queue for the live playbackstream might not even have a shuffle option. But where a shuffle optionexists, it is unlikely that the host intends to have the media contentbe shuffled in a live playback stream. In some embodiments, rather thanautomatically disabling the shuffle mode, the multi-media applicationcan display a prompt when it is determined that the shuffle option isenabled at block 408.

According to some examples, the method includes sending an instructionto initiate a live playback stream over the Internet to the multi-mediaplatform at block 412. For example, the multi-media applicationexecuting on host computing device 102 or artist computing device 224illustrated in FIG. 2 may send an instruction to initiate a liveplayback stream over the Internet to the multi-media platform.

According to some examples, the method includes initiating at least twostreams between the multi-media application and the multi-media platformat block 414. For example, the multi-media application executing on hostcomputing device 102 or artist computing device 224, illustrated in FIG.2 , may initiate at least two streams between the multi-mediaapplication and the multi-media platform. One stream is a playbackcontrol channel, and another stream is a live media stream fortransmitting data encoding live commentary. The playback control channelis for transmitting an identification of a least a portion of the mediacontent in the queue of media content and data regarding playbackcontrols pertaining to the media content.

According to some examples, the method includes capturing the commentaryby a microphone or video capture device on the client device executingthe multi-media application at block 416. For example, the multi-mediaapplication executing on host computing device 102 or artist computingdevice 224 illustrated in FIG. 2 may capture the commentary by amicrophone or video capture device.

According to some examples, the method includes transmitting the dataencoding the live performance as part of the live media stream at block418. For example, the multi-media application executing on hostcomputing device 102 or artist computing device 224 illustrated in FIG.2 may transmit the data encoding the live performance as part of thelive media stream. The live media stream can include encoded markers asreference points along with the live performance recording. The playbackcontrol channel can reference the encoded markers to indicate where thatportion of the live performance corresponds to the playback of therecorded media content.

FIG. 5 illustrates an example method for connecting to a live playbackstream provided by a multi-media service by an audience member clientdevice. Although the example method depicts a particular sequence ofoperations, the sequence may be altered without departing from the scopeof the present disclosure. For example, some of the operations depictedmay be performed in parallel or in a different sequence that does notmaterially affect the function of the method. In other examples,different components of an example device or system that implements themethod may perform functions at substantially the same time or in aspecific sequence. The example method may be described with reference tothe environments, architectures and systems described in the examplesherein, although the methods may be implemented in a wide variety ofother environments, architectures and systems.

According to some examples, the method includes initiating at least twostreams between the audience member client device and the multi-mediaplatform at block 502. For example, the audience member client device110 illustrated in FIG. 1A may initiate at least two streams between theaudience member client device 110 and the multi-media platform 108. Onestream is a playback control channel, and another stream is a live mediastream. The live media stream is for transmitting data encoding a liveperformance such as commentary. The playback control channel is fortransmitting an identification of a least a portion of the media contentin a queue of media content and data regarding playback controlspertaining to the media content.

According to some examples, the method includes determining whether anyof the media content in the queue of media content identified using theplayback control channel are cached by the audience member client deviceat block 504. For example, the audience member client device 110illustrated in FIG. 1A may determine whether any media content in thequeue of media content identified using the playback control channel arecached by the audience member client device. When the media content arecached at the client device, the connecting client plays the mediacontent from its cache as instructed by data in the playback controlchannel. When the media content are not cached at the client device, theaudience member client device 110 can request the media content from themulti-media service prior to receiving an instruction to play the mediacontent over the playback control channel.

According to some examples, the method includes multiplexing the liveperformance encoded in the live media stream with a currently playingmedia content using multiplexing information and playback stateinformation received over the playback control channel on the audiencemember client device connected to the live playback stream at block 506.For example, the audience member client device 110 illustrated in FIG.1A may multiplex the live performance encoded in the live media streamwith a currently playing media content using multiplexing informationand playback state information received over the playback controlchannel on the audience member client device connected to the liveplayback stream.

According to some examples, the method includes receiving a link forproviding at least one content for acquisition at block 508. Forexample, the audience member client device 110 illustrated in FIG. 1Amay receive a link for providing at least one content for acquisition.

According to some examples, the method includes displaying the contentfor acquisition as an actionable link in a user interface at block 510.For example, the audience member client device 110 illustrated in FIG.1A may display the content for acquisition as an actionable link in auser interface.

According to some examples, the method includes receiving a selection ofan actionable link by the user of the audience member client device atblock 512. For example, the audience member client device 110illustrated in FIG. 1A may receive a selection of the actionable link bythe user of the audience member client device.

According to some examples, the method includes requesting a landingpage at block 514. For example, the audience member client device 110illustrated in FIG. 1A may request a landing page. In some embodiments,the landing page is hosted by an e-commerce platform.

FIG. 6A and FIG. 6B illustrate example user interfaces of multi-mediaapplication 106 pertaining to a live playback stream. In FIG. 6A aparticular live playback stream 602 is advertised to begin shortly 612.User interface in FIG. 6A can present a selectable user interface option604 wherein an audience member can select the option 604 in order tosubscribe to alerts pertaining to the upcoming live playback stream.

FIG. 6B illustrates an example user interface of multi-media application106 as the live media stream 602 is currently playing 614. Asillustrated in FIG. 6B the multi-media application 106 can presentaudience statistics 606, a currently playing media content 608, and canalso present items available to purchase such as merchandise 610 offeredfor sale by the host user account.

In some embodiments, host user account can announce that they will hosta live media stream to begin at a scheduled time. Once the live mediastream has begun, an audience member can connect to the live mediastream. In some embodiments, the audience member does not need to havean account with the multi-media platform 108 and might not have themulti-media application 106 downloaded on their audience member clientdevice 110. In such embodiments the multi-media application 106 can berun in a web browser to gain access to the live media stream. During thelive media stream the host user account can control playback of recordedmedia content and can also provide a live performance such ascommentary.

The audience member can also interact with the host through one or morecommunication platforms. For example the audience member can chat, text,or conference with the host.

FIG. 7A and FIG. 7B illustrate an example method for engaging fans ofartist accounts. Although the example method depicts a particularsequence of operations, the sequence may be altered without departingfrom the scope of the present disclosure. For example, some of theoperations depicted may be performed in parallel or in a differentsequence that does not materially affect the function of the method. Inother examples, different components of an example device or system thatimplements the method may perform functions at substantially the sametime or in a specific sequence. The example method may be described withreference to the environments, architectures, and systems described inthe examples herein, although the methods may be implemented in a widevariety of other environments, architectures and systems.

The present technology aims to provide a service with a low amount offriction for artists to engage with fans. As described above, thepresent technology provides for hosting live playback streams whereartists can showcase their recorded media content and otherwise engagewith fans.

In addition to engaging with fans, artists would also like to receivemetrics regarding the users connected to their live playback streams. Insome embodiments, artists would further like to be able to contact theirfan base outside of informing them of live playback streams. In someembodiments, the ability to communicate with users that have useraccounts with the multi-media platform 108 that are fans of an artistaccount can be valuable enough that the artist accounts might be willingto share portions of the royalty payouts that the multi-media platform108 makes to the artist accounts for the playback of their recordedmedia content.

FIG. 7A illustrates an example of creating a mailing list for an artistaccount.

According to some examples, the method includes creating a mailing listfor the particular artist from the user accounts from the population ofuser accounts having the strongest affinity for the particular artist atblock 702. For example, the multi-media platform 108 illustrated in FIG.1A may create a mailing list for the particular artist from thepopulation of user accounts with the strongest affinity for theparticular artist.

According to some examples, the method includes sharing the mailing listwith a user account for the particular artist at block 704. For example,the multi-media platform 108 illustrated in FIG. 1A may share themailing list with a user account for the particular artist. The useraccount for the particular artist is an artist account. Data from themailing list can identify the user accounts in the mailing list by ananonymous ID or by a public user name. Contact information and personalidentifying information are not shared with the particular artist.

According to some examples, the method includes receiving an input fromthe verified user account of the artist to send a notification to themailing list at block 706. For example, the multi-media platform 108illustrated in FIG. 1A may receive an input from the verified useraccount of the artist to send a notification to the mailing list.

According to some examples, the method includes sending the notificationto the user accounts on the mailing list at block 708. For example, themulti-media platform 108 illustrated in FIG. 1A may send thenotification to the user accounts on the mailing list. The notificationincludes a security token. The notification is sent to the users of theuser accounts using a communication channel preference stored withrespect to the user account.

FIG. 7B illustrates an example method of providing differentiated levelsof engagement for some users, especially users that are loyal users.

According to some examples, the method includes providing additionaluser engagement options at block 710. For example, the collaborationcomponent 112 illustrated in FIG. 1A may provide additional userengagement options, including sending chat messages to the broadcaster.In some embodiments, the event is a special live playback stream thatthe artist account uses to provide an intimate live performance to aselect subset of fans.

According to some examples, multi-media platform 108, illustrated inFIG. 1A, may collect information associated with user accounts toidentify top fans of an artist account. The information associated withuser accounts can include media content preference information, socialchannel information, and/or purchase information. The media contentpreference information is derived from explicit data provided by userinputs indicating an affinity for an artist or a media content andimplicit data such as playback data and engagement data, including skipcounts, play counts, and purchases. The social channel information isreceived from one or more social platforms and can include data aboutsocial contacts and follower information, topic engagement, and contentengagement. The purchase information can be received from one or morepayment networks indicating spending pertaining to engagement with mediacontent or artists. The media content preference information can be usedto identify the loyal users segment of users. A loyal user can be a useraccount that demonstrates a high affinity for the artist or one of therecorded media content performed by the artist. A loyal user can also bea user account that demonstrates a high level of engagement with anartist by joining the most live playback streams, buying the mostmerchandise, or hosting live playback streams that feature the artist.

According to some examples, the method includes inviting users to anevent hosted by the artist account at block 714. For example, thecollaboration component 112 illustrated in FIG. 1A may invite loyalusers to an event hosted by the artist account. In some embodiments, theinvitation can include a security token to ensure that only the inviteduser account can join the event. In some embodiments, the event is alive chat or video conference. In some embodiments, the event is aspecial live playback stream that the artist account uses to provide anintimate live performance to a select subset of fans. The event canoccur within or outside the multi-media platform such as a social mediaplatform, video conferencing platform, chat platform, etc.

According to some examples, the method includes receiving a request toaccess the event at block 716. For example, the collaboration component112 illustrated in FIG. 1A may receive a request to access the event.

According to some examples, the method includes determining whether therequest includes a received security token at block 718. For example,the collaboration component 112 illustrated in FIG. 1A may determinewhether the request includes the received security token. The securitytoken can be used to ensure that any invitations are not shared outsideof the user account that has been invited to the event.

According to some examples, the method includes sending a pushnotification to a MFA component to provide secondary authentication ofthe user account prior to allowing the user access to the event at block720. For example, the collaboration component 112 illustrated in FIG. 1Amay send a push notification to a MFA component to provide secondaryauthentication of the user account prior to allowing the user access tothe event.

As described herein, certain examples have been given wherein an artistaccount can have additional privileges for hosting live playback streamsthat may not be available to general user accounts hosting live playbackstreams. However, the present technology acknowledges that some generaluser accounts may be so successful at hosting live playback streams thatthey generate a significant following. Accordingly, in some embodiments,the present technology can identify general user accounts for promotionto become an artist account even though that account may not beassociated with any recorded media content other than archives of pastlive playback streams. For example, multi-media platform 108 candetermine that one or more past live playback streams from a generaluser account had a popularity above a threshold. The popularity above athreshold can be a number of audience member accounts connected to thelive playback stream. In some embodiments, the popularity above athreshold may be required to be maintained over some number of playbackstreams to ensure that the number of connected accounts is not somehowartificially inflated.

FIG. 8 illustrates an example method for presenting one or more userinterfaces associated with live playback streams. Although the examplemethod depicts a particular sequence of operations, the sequence may bealtered without departing from the scope of the present disclosure. Forexample, some of the operations depicted may be performed in parallel orin a different sequence that does not materially affect the function ofthe method. In other examples, different components of an example deviceor system that implements the method may perform functions atsubstantially the same time or in a specific sequence. The examplemethod may be described with reference to the environments,architectures, and systems described in the examples herein, althoughthe methods may be implemented in a wide variety of other environments,architectures and systems.

According to some examples, the method includes presenting broadcastcontrols at block 802. For example, the multi-media application maypresent live playback stream controls such as illustrated in FIG. 9B.The live playback stream controls include at least an input switchingcontrol 930, a microphone control 906, a sound effects control 928, andlistener statistics 912.

According to some examples, the method includes presenting a mixinginterface at block 804. For example, the multi-media application maypresent a mixing interface 920 illustrated in FIG. 9B. The mixinginterface includes a penannular slider 920 about a source toggle 906. Asillustrated in FIG. 9B, the source toggle is a microphone source 906.

The penannular slider 920 is configured to accept an input to drag anindicator 922 about the penannular slider. A first terminal end 926 ofthe penannular slider is configured to cause a majority of audio to comefrom a microphone input. A second terminal end 924 of the penannularslider is configured to cause a majority of audio to come from playbackof the media content. Locations between the first terminal end and thesecond terminal end are configured to mix audio from the microphonesource and the playback of media content according to respectivedistances from each of the terminal ends such that the closer theindicator is to the first terminal end 926, the greater the volume fromthe microphone source compared to the playback of media content. Thecloser the indicator is to the second terminal end 924, the greater thevolume from the playback of media content compared to the microphonesource.

According to some examples, the method includes presenting at least oneoption for an available input other than the microphone and recordedmedia content playback at block 806. For example, the multi-mediaapplication may present at least an input switching control 930 toselect an available input other than the microphone and recorded mediacontent playback.

According to some examples, the method includes receiving the selectionof the available input other than the microphone and recorded mediacontent playback at block 808. For example, the multi-media applicationmay receive the selection of the available input other than themicrophone and recorded media content playback. Responsive to receivinga selection of the input switching control, the method includespresenting the mixing interface wherein one of the terminal ends of thepenannular slider 920 represents the selected available input other thanthe microphone and recorded media content playback at block 810. Forexample, the multi-media application may present the mixing interfacewherein one of the terminal ends of the penannular slider 920 representsthe selected available input other than the microphone and recordedmedia content playback.

According to some examples, the method includes receiving a selection ofthe sound effects control at block 812. For example, the multi-mediaapplication may receive a selection of the sound effects control 928illustrated in FIG. 9B.

Responsive to the selection of the sound effects control, the methodincludes presenting sound effects options at block 814. For example, themulti-media application may present sound effects options 934illustrated in FIG. 9C. In some embodiments, the sound effects caninclude a collection of samples.

According to some examples, the method includes receiving a selection ofa sample from the sound effects options at block 822. For example, themulti-media application may receive a selection 936 of a sampling optionfrom one of the sampling options.

According to some examples, the method includes automatically mixing thesample into a currently playing media content at block 824. For example,the multi-media application may automatically mix the sample into acurrently playing media content.

According to some examples, the method includes presenting transitionoptions at block 816. For example, the multi-media application maypresent transition options 944 as illustrated in FIG. 9D.

According to some examples, the method includes receiving a selection ofa crossfade option from one of the transition options at block 818. Forexample, the multi-media application may receive a selection of acrossfade option from one of the transition options. An active crossfadeoption 942 is illustrated in FIG. 9D.

According to some examples, the method includes automatically applyingthe active crossfade option to transition from the end of the currentlyplaying media content to the beginning of the subsequent media contentat block 820. For example, the multi-media application may automaticallyapply the active crossfade option to transition from the end of thecurrently playing media content to the beginning of the subsequent mediacontent. At a transition from a currently playing media content to asubsequent media content.

FIG. 9A illustrates an example streaming service user interface of amulti-media application, according to an embodiment of the presentsubject matter. As illustrated in FIG. 8A, the playback queue 902contains a list of media content to be played back. A user of a useraccount of the multi-media platform 108 can select recorded mediacontent (displayed using metadata, such as artist name, song name, albumcover, lyrics, genre, descriptive data, etc.) to populate the playbackqueue 902 to prepare for a live playback session. When the user of theuser account is ready to initiate the live playback session the user canselect the live user interface button 904.

In some embodiments, the user interface can be presented via amulti-media application on the host computing device 102, a web browseron the host computing device 102, and/or the like, as a web interface,mobile interface, an instant application, or a progressive webapplication. In some embodiments, the user interface includes a mediaplayer to play media content, such as text, still images, video, andaudio, etc. The media player can include graphical elements that, whenselected, cause media playback or viewing functions, such as play,pause, stop, skip, etc. A user may select the graphical elements in anyappropriate manner, such as a mouse click, a keyboard input, a touchinput, a voice input, etc. In some embodiments, media player includesoutput elements, such as a “now playing” window, that show informationabout the recorded media content that the media player is currentlyplaying. In some embodiments, the media player includes playbackcontrols, playlist information, and a now playing window. In someembodiments, the media player is capable of displaying otherinformation, such as images (e.g., album art), text (e.g., lyrics),scrolling and/or synchronized text (e.g., karaoke display), videos(e.g., music videos), and the like. Different combinations of mediaplayer controls, including different, more, or fewer controls are alsopossible. Moreover, the type of media player functionalities may changedepending on the type of recorded media content being played back.

In some embodiments, a host user may request playback of a mediacontent, e.g., a song. Other audience members subscribing to the hostuser's live playback stream can experience the playback controlled bythe host user. The audience members can “react” to the song choice orinitiate communication with the host user in a window, e.g.,interstitial (not shown) associated with the user interface. In someembodiments, the user can react by sending a “like” (on fire icon) andsending monetary tips to the host. In some embodiments, the host canmodify playlists or otherwise engage with the other users. In someimplementations, the other users can be ranked based on “loyal” status.Accordingly, in some examples, the user is able to assign incentives orreactions to the other users, either in the same window or separatewindow as communication messages.

FIG. 9B illustrates a live playback session management user interface.As illustrated in FIG. 9B, a user can select the live playback sessionmanagement user interface button 908 to navigate to the sessionmanagement user interface illustrated in FIG. 9B. The system managementuser interface includes a menu of listener statistics 912. The listenerstatistics 912 can include a number of listeners 914, a number of likes916, and tips 918. The tips can be financial rewards. The managementuser interface also includes a private listening mode user interfacebutton 910. The private listening mode user interface button 910 can beused by a host to terminate the live playback session.

In some embodiments, the management user interface also includes aninterface for mixing multiple sources. As illustrated in FIG. 9B, theinterface is a penannular slider 920 where the slider control 922 can bemanipulated to move towards media playback source 924 or to the secondinput source 926. The closer the slider is to one of the sources, thelouder that particular source is relative to the other source.

As illustrated in FIG. 9B, the second input source 926 is a microphone.However, a user can select button 930 for the input menu to select othersources. Additionally, a host can add various effects to be mixed inwith recorded media content. These effects can be selected from theeffects menu button 928.

FIG. 9C illustrates an example sound effects menu page. A user cannavigate to the sound effects menu page by selecting the samples menunavigation button 932. The sound effects menu page includes a samplesmenu 934. A user can select one of the samples such as selected sample936 and the sample can be automatically mixed into a recorded mediacontent selected for playback.

FIG. 9D illustrates a user interface for selecting transition options.The user can navigate to this page by selecting the transition optionmenu navigation button 938. As shown in FIG. 9D the user can select froma menu of transitions 944. In FIG. 9D, a crossfade transition has beenselected. The transition can be applied between the playback of twodifferent media content. In some embodiments, the user can select whenthe transition can begin using the start transition user interfacebutton 942.

The user can also initiate or cancel a live media session using the liveplayback stream controls 940.

In some embodiments, the user can apply “mix rules” to each of the songsthat apply effects to the media content (e.g., flanger, reverb,delay/echo, etc.), generate mixes of the media (e.g., overlays ofmultiple content items or samples thereof, overlays of additionalinstruments or sounds, crossfades between content items, etc.), andadjust playback attributes of the media (e.g., volume, equalizersettings, etc.) based on user selections or system generated rules forplayback and/or distribution of the mixed content.

The mix rules can change based on social graphs (e.g., what nearbyusers, friends, family, or other related users) are using. Mix rules canalso be based on how other songs with a similar “fingerprint” have beenmixed. “Fingerprinting” is defined herein as converting an unknown musicsample, represented as a series of time-domain samples, to a match of aknown song, which may be represented by a song identification (ID). Thesong ID may be used to identify metadata (song title, artist, etc.) andone or more recorded tracks containing the identified song (which mayinclude tracks of different bit rate, compression type, file type,etc.). The term “song” refers to a musical performance as a whole, andthe term “track” refers to a specific song in a digital file. Note that,in the case where a specific musical composition is recorded multipletimes by the same or different artists, each recording is considered adifferent “song”. The term “sample” refers to audio content presented asa set of digitized samples. A music sample may be all or a portion of atrack, or may be all or a portion of a song recorded from a liveperformance or from an over-the-air broadcast.

In some embodiments, the multi-media platform 108 can provide adashboard, or an information management tool that enables the artist 222to visually track, analyze, and/or display key performance indicators(KPI), metrics, and/or key data points to monitor the health of abusiness, department, or specific process. In some examples, the userinterface can be presented via a point-of-sale application (e.g.,associated with a payment processing service offered by the serviceprovider) and/or another application associated with a service providedby the service provider. In some examples, the user interface can bepresented via a user-facing messaging application. In some embodiments,the functional component configured to present the user interface canobtain communications and/or other data from one or more customer-facingservices/platforms and/or communication channels. In some examples, theuser interface can be associated with actuation mechanism(s) that enablethe user to navigate to other functional component(s) associated withservice(s) available via the service provider. In some examples, byactuating one of the actuation mechanism(s), the application, webbrowser, and/or the like can navigate to a functional componentassociated with the corresponding service. In some examples, anotherapplication or web page can open to provide access to the correspondingservice.

In some examples, the user interface can include a section that canpresent information relevant to the user. In some examples, the sectioncan include activity, KPIs, and/or the like. In some embodiments, theuser interface can include one or more elements, which can include text,images, pictures, videos, and/or the like to enable the user to navigateto other functional components, such as an electronic calendar userinterface, a consolidated communication user interface, a help userinterface, and/or the like. In some embodiments, the content and/orconfiguration of content associated with the user interface can becustomizable to meet the specific needs of the user.

In some embodiments, the one or more elements can be associated withrespective actuation mechanisms, such that an input associated with oneof the one or more elements can cause a corresponding user interface, orportion thereof, to be presented via the user interface, or a portionthereof.

FIG. 10 is a block diagram of an example method for enabling artistfinancing, reevaluating terms and/or repayment of the financing, andproviding an incentive to the artist. Although the example methoddepicts a particular sequence of operations, the sequence may be alteredwithout departing from the scope of the present disclosure. For example,some of the operations depicted may be performed in parallel or in adifferent sequence that does not materially affect the function of themethod. In other examples, different components of an example device orsystem that implements the method may perform functions at substantiallythe same time or in a specific sequence. The example method may bedescribed with reference to the environments, architectures, and systemsdescribed in the examples herein, although the methods may beimplemented in a wide variety of other environments, architectures, andsystems.

According to some examples, the method illustrated in FIG. 10 includescalculating financing terms based on various factors associated with theartist at block 1002. For example, the financing engine 214 illustratedin FIG. 2 may calculate financing terms based on various factorsassociated with the artist. For example, as described above, some ofthese factors can be based, in part, on financial transactions conductedby the artist through the payment processing service 220 or by usingdata/metrics to determine predictors of future success of a mediacontent (using media content value component 204) to provide a cashadvance to artists or similar artists for a purpose to which the fundsare being used (if provided by the artist), a score associated withtheir digital rights (in comparison to what other right holders hold,sole author of the song or not), a loyalty score associated with thechurn of fans (existing vs new fans), third-party data relating toartist content, the number of artists associated with the track andwhether they have requested funds as well, their ability to collectpayments via merchandize, tips, tickets, royalties, time-based number ofstreams (daily, monthly, yearly), engagement during live streams, etc.In some examples, the financing terms are based on the ownership modelof the artist and what revenues they will get as dictated by the modeland accordingly how soon/late can the loan provider be reimbursed forextending loans as a result of the ownership model. The financing termsmay include, for example, a financing amount, a fee for the financing(e.g., a percentage of the amount financed or a fixed fee), and a ratefor repayment for the amount financed and the fee (e.g., an amount to bewithheld from financial transactions processed for the artist throughthe payment processing service 220).

According to some examples, the method illustrated in FIG. 10 includesdetermining whether the artist account qualifies for recommendations toimprove the financing terms at decision block 1004. For example, thefinancing engine 214 can determine one or more actions that the artistcould take that would make the financing offer less risky, and if suchactions exist, the financing engine 214 can determine that the artistqualifies for recommendations to improve the financing terms. Forexample, if the artist account has enough followers, the artist accountcould qualify for improved financing terms if they were to do apromotion with their fans to increase sales.

According to some examples, the method illustrated in FIG. 10 includesproviding recommendations on actions that the artist could take toimprove the financing terms when it was determined that the artistaccount qualifies for such offers at block 1006. For example, thefinancing engine 214 can provide recommended actions that the artistcould take to improve the financing terms when it was determined thatthe artist account qualifies for such offers. For example, financingengine 214 could suggest engaging with fans to do a promotion oroffering a targeted engagement with super fans, etc.

According to some examples, the method illustrated in FIG. 10 includesproviding the financed amount to the artist at block 1008. For example,the financing engine 214 illustrated in FIG. 2 may provide the financedamount to the artist. For example, the payment processing system maytransmit the funds via wire transfer, deposit the funds in a financialaccount associated with the artist, submit to a peer-to-peer account,and automatically route the funds to an artist's purpose, such asinstrument financing or studio booking, or the like.

According to some examples, the method illustrated in FIG. 10 includesreceiving and processing transactions for the artist at block 1010. Forexample, the financing engine 214 illustrated in FIG. 2 may receive andprocesses transactions for an artist. For example, as describedelsewhere herein, the payment processing system may process financialtransactions between the artist and customers/streamingusers/labels/publishers, e.g., when the artist is paid for their mediacontent, merchandise, concert performances, etc.

According to some examples, the method illustrated in FIG. 10 includeswithholding a portion of the transaction funds from those sent to theartist at block 1012. For example, the payment processing service 220illustrated in FIG. 2 may withhold a portion of the transaction fundsfrom those sent to the artist. For example, for each streaming revenuecollected, the server 102 may withhold 10% for repayment of the amountfinanced according to the calculated loan terms and send the remainingrevenue to the artist. In another implementation, the server 102 canobtain revenues through other artist-related acquisition channels, suchas merchandise sales, concert tickets, etc.

According to some examples, the method illustrated in FIG. 10 includesdetermining an incentive for the artist and transmitting an offerdefining the incentive terms at block 1014. For example, the serviceprovider or 204 illustrated in FIG. 2 may determine an incentive for theartist and transmit an offer defining the incentive and an actionrequired of the merchant to receive the incentive (e.g., a performancetarget). For example, as described elsewhere herein, the incentive termsmay include the action to be performed by the merchant as well as whenand what incentive will be provided in exchange for the artist'sactions.

According to some examples, the method illustrated in FIG. 10 includesdetermining if the artist has met the requirements contained in theincentive terms at block 1016. For example, the service provider orfinancing engine 214 illustrated in FIG. 2 may determine if the artisthas met the requirements contained in the incentive terms. In someembodiments, the financing engine 214 may track an artist's activitiesuntil the requirements have been met. For example, the financing engine214 may monitor the transactions processed for the merchant through thepayment processing service 220 to determine if the volume oftransactions has increased according to the incentive terms.

According to some examples, the method illustrated in FIG. 10 includesproviding the incentive to the artist when the artist has met therequirements contained in the incentive terms at block 1018. Forexample, the payment processing service 220 illustrated in FIG. 2 mayprovide the artist incentive when the requirements in the incentiveterms have been met.

In some implementations, the financial offers are associated withspecific recorded media content. Furthermore, in some examples, theservices illustrated in FIG. 2 allow third-party APIs/SDKs to be exposedto multi-media platform 108 to obtain streaming data. In someembodiments, the lending infrastructure is implemented using smartcontracts and/or DeFi technologies. In some implementations, the lendingprovider can be a crowdsourced entity where the artist's audience can beinvested in the album, e.g., by gaining interest in the royalty model.In some implementations, an artist can be associated with multi-mediaplatform 108 through their artist account. The lending provider can bethe financing engine 214 or an entity that can generate a financialoffer backed by an NFT in the media content. The financial offer can bedisbursed into a P2P account associated with the multi-media platform108, and the artist can be given a payment instrument unique to artistsand with media-specific rewards and functionalities, with additionalrewards that influence spend into a server ecosystem that supportsmusic.

FIG. 11 illustrates an example method for determining a value of a mediacontent or a sample of media content as described herein. Although theexample method depicts a particular sequence of operations, the sequencemay be altered without departing from the scope of the presentdisclosure. For example, some of the operations depicted may beperformed in parallel or in a different sequence that does notmaterially affect the function of the method. In other examples,different components of an example device or system that implements themethod may perform functions at substantially the same time or in aspecific sequence. The example method may be described with reference tothe environments, architectures, and systems described in the examplesherein, although the methods may be implemented in a wide variety ofother environments, architectures, and systems.

According to some examples, the method illustrated in FIG. 11 includesdetermining whether to assign a value to one or more portions of a mediacontent at block 1102. For example, the media content value component204 illustrated in FIG. 2 may determine whether to assign a value to oneor more portions of a recorded media content. In some embodiments, atrigger to determine a value for one or more portions of the recordedmedia content can be a request to acquire, license, or playback therecorded media content. In some embodiments, the trigger to determinethe value for one or more portions of the recorded media content can bethe result of a condition specified in a smart contract maintained by ablockchain network.

According to some examples, the method includes monitoring market datapertaining to the recorded media content at block 1104. For example, themedia content value component 204 illustrated in FIG. 2 may monitormarket data pertaining to the recorded media content. The market datacan include a list price and historical sales volume for the mediacontent as reported by multi-media platform 108 or other media services.The monitoring of the market data also pertains to market data relatingthe a value of portions of a media content, such as a sample of a musiccontent.

According to some examples, the method includes determining whether atleast one market trend meets a defined metric at decision block 1106.For example, the media content value component 204 illustrated in FIG. 2may determine whether at least one market trend meets a defined metric.For example, the media content value component 204 may evaluate at leastone market trend pertaining to similar media content to the recordedmedia content to be valued. The at least one market trend is chartsdata, critical review scores, and social media interaction with similarmedia content. For example, a recorded media content may become morevaluable when it is the most popular. There are top charts that show howpopular the recorded media content such as albums, books, songs, andvideos might be. There are earnings charts for some recorded mediacontent that indicate how many people are purchasing or experiencing therecorded media content. For some recorded media content, critics mightprovide reviews on a scale from 1 to 5. For some recorded media content,social media users might link to the recorded media content or refer tothe recorded media content by name or a proxy such as a hashtag. All ofthese are signals of the value of a recorded media content. When onesuch trend meets a metric indicating it is substantial enough thepresent technology can value the media content.

According to some examples, the method includes determining a spot pricefor the media content to be valued at block 1108. For example, the mediacontent value component 204 illustrated in FIG. 2 may determine a spotprice for the recorded media content based on the market data and theevaluation of the at least one market trend. In some embodiments, a spotprice can refer to a current value of a recorded media content. Givenall of the data available as indicators of a value of a recorded mediacontent, the present technology acknowledges that recorded media contentcan have a dynamic value, especially when friction to acquiring orlicensing the media content can be removed using technologies such as adistributed ledger or blockchain. Thus, a spot price can refer to amarket value for a particular type of transaction involving a specificrecorded media content at a specific time. The determining of a spotprice for the recorded media content to be valued can be performed by amachine learning algorithm receiving the market data and the at leastone market trend.

In some embodiments, an artist can define a target value for a recordedmedia content, and the media content value component 204 canperiodically provide an estimated value for the media content. In someembodiments the media content value component 204 can surface thisinformation in a dashboard of the multi-media platform 108 through thedashboard component 246. In some embodiments, media content valuecomponent 204 can display key performance indicators used to value themedia content to help the artist determine actions that might be takento improve the performance metrics and thereby the value of the mediacontent.

In some embodiments, a customized token can be associated with eachrecorded media content such that the value of the token tracks the“success” of the recorded media content (as determined, for example, bystream count, royalty, distribution of rights score, etc.).

There may be a finite number of tokens associated with the recordedmedia content such that investment towards the tokens is used towardsartist financing, artist album purchases, future album purchases, etc.

According to some examples, the method includes identifying possiblesamples of the media content to be valued at block 140. For example, themedia samples component 218 illustrated in FIG. 2 may identify possiblesamples of the media content to be valued. A sample can be a segment orportion of a media content. The term “sample” is most often used inreference to a portion of an audio track wherein a small time segment,or even just the sound of one instrument or sound in the track, can beextracted for use in other media content. However, samples can alsorefer to any division of a larger recorded media content, such as a songof an album, a scene of a movie, a segment of a larger picture like aparticular mural or portion of a mural (e.g., such as from the ceilingof the Sistine Chapple).

These samples can also be valued. According to some examples, the methodincludes valuing the spot price of the possible sample using market datafor at least one similar sample previously licensed at block 150. Forexample, the media content value component 204 illustrated in FIG. 2 mayvalue the spot price of the possible sample using market data for atleast one similar sample previously licensed. A similar sample is asample of a recorded media content having similar characteristics orbelonging to a similar genre.

In some embodiments, the spot price for the recorded media content to bevalued is further based on the spot price of the at least one possiblesample of the recorded media content.

Such dynamic spot prices for samples of recorded media content can besurfaced to the artist, who can then promote their media content. Insome embodiments, machine learning techniques can also be used topredict future value changes.

FIG. 12 illustrates an example method for implementing distributedledger technology in media management as described herein. Although theexample method depicts a particular sequence of operations, the sequencemay be altered without departing from the scope of the presentdisclosure. For example, some of the operations depicted may beperformed in parallel or in a different sequence that does notmaterially affect the function of the method. In other examples,different components of an example device or system that implements themethod may perform functions at substantially the same time or in aspecific sequence. The example method may be described with reference tothe environments, architectures, and systems described in the examplesherein, although the methods may be implemented in a wide variety ofother environments, architectures, and systems.

Ownership of rights to digital and physical assets or collectibles maybe recorded in non-fungible tokens (NFTs), a customized music token, andrecorded in a blockchain, such as Ethereum. In some embodiments, smartcontracts are provided using chaincode, (e.g., such as system chaincodeavailable in Hyperledger Fabric 1.0) that can track the digital rights(ownership, license, royalty structures, etc., and conditions fortransfer of rights) associated with media content. Through a pluralityof smart contracts or chain code, the distributed ledger 208 canmaintain a consensus between different blockchains with relation touser's wallets and underlying NFTs, route an incoming transaction to oneof the blockchain(s), e.g., based on context data, and then enableprocessing of the transaction on the blockchain.

“Non-fungibility” refers to the uniqueness or non-interchangeability ofindividual units of an asset. For example, NFTs cannot be replaced withother tokens of the same type. An example format for an NFT on theEthereum blockchain is a token standard referred to as ERC-721. TheERC-1155 standard offers semi-fungibility. Unlike ERC-721, where theunique identifier represents one asset, the unique identifier of theERC-1155 token represents a whole class of fungible assets, any numberof which the user can transfer to others. Components based on theERC-998 standard are the templates according to which NFTs can be eithernon-fungible or fungible assets. While Ethereum is a popular choice forNFT marketplaces, there are non-Ethereum NFT marketplaces as well,belonging to other blockchain networks like Cosmos, Polkadot,International Blockchain Consulting (IBC), Interledger, Binance SmartChain, etc. Each of the NFT marketplaces operates slightly differentlyand has its specific instructions, standards, formats, and/or the like.For example, some of the NFTs are curated while others are self-servicebased. Creating NFTs on some platforms have substantial transaction feesto mint, while some marketplaces do not support specific file formats orsizes of assets. Some platforms are user-friendly, while others have acomplex user interface that takes significant training.

According to some examples, the method includes minting or transferringan NFT referencing ownership of a right associated with at least aportion of the recorded media content at block 1202. For example, theNFT component 206 illustrated in FIG. 2 may mint an NFT on a specificblockchain if one doesn't exist already on distributed ledger 208 (e.g.,per user preferences) referencing ownership of a right associated withat least a portion of the recorded media content. At least one conditionis an agreement to pay a spot price for the value of the assignment. Thesmart contract references one or more conditions for acquiring anassignment of the copyright to control the recorded media content. Thesmart contract references one or more conditions for acquiring a copy ofa recorded media content for personal playback. The smart contractreferences one or more conditions for licensing a recorded media contentfor public playback. The smart contract references one or moreconditions for licensing the recorded media content for use of a sampleof the media content in another media content. The NFT component 206 canbe configured to mint an NFT for one or more media content in near realtime, according to user's preferences (e.g., specific blockchain,expiration time, user's preferences, user's location (e.g., if it isdetected that a user is operating in a wallet on a different blockchain)and the context of the conversation (or live media content) between thehost and the connected user.

According to some examples, the method includes storing the NFT on ablockchain network at block 1204. For example, the NFT component 206illustrated in FIG. 2 may store the NFT on a blockchain network 208.

According to some examples, the method illustrated in FIG. 12 includesdetermining a value of a non-fungible token at block 1206. In someembodiments, the value of an NFT can be determined from its spot price,as addressed with respect to FIG. 11 . In other examples, the value ofan NFT can be a traded value determined by open market trading, whereinthe price of an NFT is determined by the junction of buy and sellprices, just as in any open market.

According to some examples, the method illustrated in FIG. 12 includesdetermining whether the conditions associated with a smart contract havebeen satisfied at decision block 1208. For example, the smart contractarbiter component 212 illustrated in FIG. 2 may determine whether theconditions associated with a smart contract have been satisfied.

A smart contract relating to an NFT can include any of the followingterms: a user subscribes to the media content; the acquires a license toplayback the recorded media content during a specified period; the userdownloads the recorded media content and acquires rights to playback themedia content for the personal or family user for an undetermined periodof time; or the user acquires rights to control future licensing of therecorded media content. In an example use case, a recorded media content(e.g., a behind the scene photo of an artist shot by a photographer, ora limited release song) can be sold by an artist to a fan using smartcontracts such that the artist is paid each time the photo issubsequently sold/distributed.

According to some examples, the method illustrated in FIG. 12 includesexecuting the terms of a smart contract at block 1210. For example, thesmart contract arbiter component 212 illustrated in FIG. 2 may executethe terms of a smart contract. The smart contract has embedded thereinrights to the recorded media content such that execution of the smartcontract in response to the request causes assignment of the rights tothe user generating the request and automatic disbursement of instantpayments to the right holders as per terms of the smart contract tooffer decentralized management of recorded media content In someembodiments, the requests can be requested by users willing to buy orrent/stream the recorded media content. In some examples, the requestcan be automatically triggered when a certain portion or 30 seconds (forexample) of the recorded media content is accessed.

In some examples, the financing engine 214 provides funds for creatingthe recorded media content, records it as a smart contract, tracks theusage of the recorded media content and revenue associated with it, andthen keeps a portion of the revenue towards the funding while releasesthe rest of the revenue to the artist. In some embodiments, if theartist has requested the financial offer, the financing engine 214checks to determine if there are any other contributors (thesongwriters, producers, engineers, band members and studio musicians,background vocalists, and programmers) connected to the user/artist. Ifthere are, the financing engine 214 can check if those contributors haveapplied for financial offers for the same album/different album, andbundle similar offers (e.g., applied for the same song/album/track) fordifferent financial terms and distinct revenue streams coming fromartist and/or contributors. In this case, the smart contract is betweenmulti-media platform 108 and artist and contributors.

In some examples, the present technology described herein can also useNFTs to demonstrate ownership of unique recorded media content. One ofthe big advantaged of distributed ledger is a public and agreed uponchain of title. Accordingly, the present technology can be used to trackownership of a recorded media content and to verify a number of copiesof the recorded media content in existence. In this way, the presenttechnology can be used to transfer unique recorded media content ascollectibles.

In some embodiments, an artist account can offer users of themulti-media platform 108 a unique recorded media content associated withan NFT. The users can be allowed to bid on the unique media content.

In some embodiments, an artist account can utilize NFTs can be forpersonalized media content made for users as rewards/appreciation.

In some embodiments, the server provider allows owners of different NFTsof the same album to collaborate and create the single album from thedifferent puzzle pieces and release the whole album, or even create apublic/private musical experience. The NFTs can also be time-restrictedsuch that during the time the user has access that other users do not,but at the lapse of the time, the underlying asset is available foreveryone to use.

In some examples, “my collection” tab in the music service associatedwith multi-media platform 108 can be used to digitally showcase thepurchased NFT, e.g., music users cannot hear anyone else, owned by auser. The digital showcase of NFTs can be used to assign a “loyal”status as mentioned before.

FIG. 13 illustrates an example user interface that advertises acurrently playing live playback stream. In some embodiments, when anaudience member does not have a user account that entitles them toconnect to the live playback stream the user interface illustrated inFIG. 13 can offer a free trial by presenting selectable option 1302. Theaudience member could choose instead to purchase a subscription tomulti-media platform 108, or purchase rights to connect to theparticular live playback stream.

The user interface illustrated in FIG. 13 can also provide paymentoptions 1304 such as to pay through payment services such as CASH APP,APPLE PAY, GOOGLE PAY. Additionally, the audience member could decide toprovide a tip using menu options 1306 to support the host user accountthat is the host of the live playback stream. The user interfaceillustrated in FIG. 13 can also provide a selectable option 1308 to viewmerchandise offered by the host user account.

FIG. 14 illustrates another example user interface of the multi-mediaapplication 106. The user interface illustrated in FIG. 14 showscurrently playing live media streams 1402. In some embodiments, the mostpopular currently playing live media stream 1404 can automatically beginplayback and the user interface can display an amount of time 1406remaining in a free preview of the live media stream 1404 that isautomatically playing.

FIG. 15A and FIG. 15B illustrate example user interfaces for creating auser account with the multi-media platform 108.

FIG. 16A, FIG. 16B, FIG. 16C, FIG. 16D, and FIG. 16E collectivelyillustrate a flow of user interface screens of multi-media application106. In FIG. 16A, the multi-media application 106 is navigated to a homescreen showing a plurality of live playback streams 1620, trending mediacontent collections 1626 (such as playlists and albums), and trendingmedia content 1628 that is available for selection and playback. Inaddition, the home stream of the multi-media application 106 shows itcurrently playing media content 1624. As illustrated in FIG. 16A thecurrently playing media content 1624 same media item from the currentlyplaying live playback stream 1622.

FIG. 16B illustrates a user interface showing a list of currentlyplaying and previously played media content. For example FIG. 16B showsan expanded view of the currently playing media content 1602 that ispart of the currently playing live media stream 1604. Media items 1606represent media content that were recently played.

As more playback history is developed a timeline of previously playedand queued to play media content has developed. FIG. 16C illustrates atimeline user interface showing media items queued to play 1608 andmedia items previously played 1610.

FIG. 16D illustrates an example detailed view pertaining to particularmedia content. For example, an audience member may have selected aparticular media content which results in the navigation to theinterface illustrated in FIG. 16D where we lyrics 1612 and other mediacontent information are displayed.

FIG. 16E illustrates a further user interface offered by multi-mediaapplication 106 wherein the user can select user interface option 1614to navigate to a merchandise page or other landing page. In someembodiments, the audience member can select an option 1616 to purchasemerchandise or can select an option 1618 to make a donation to theartist account.

FIG. 17 is a block diagram illustrating a system for performingtechniques described herein, according to an embodiment of the presentsubject matter. The system 1700 includes a user device 1702, thatcommunicates with server computing device(s) (e.g., server(s) 1704) vianetwork(s) 1706 (e.g., the Internet, cable network(s), cellularnetwork(s), cloud network(s), wireless network(s) (e.g., Wi-Fi) andwired network(s), as well as close-range communications such asBluetooth®, Bluetooth® low energy (BLE), and the like). While a singleuser device 1702 is illustrated, in additional or alternate examples,the system can have multiple user devices. In some embodiments, the userdevice 1702 can correspond to the host computing device 102, audiencemember client device 110 and/or the artist computing device 224 of FIG.2 , the server(s) 1704 can correspond to the multi-media platform 108,social media platform 230, NFT platform 242, or finance platform 244 ofFIG. 2 , and the network(s) 1706 can correspond to the network 216 ofFIG. 2 . In one implementation, the system offers media management,specifically media content platforms that support lending,machine-learning driven social engagement, collaborative mediaexperiences, and distributed ledger-driven licensing and media contentmanagement models.

In some embodiments, the user device 1702 can be any suitable type ofcomputing device, e.g., portable, semi-portable, semi-stationary, orstationary. Some examples of the user device 1702 can include, but arenot limited to, a tablet computing device, a smart phone or mobilecommunication device, a laptop, a netbook or other portable computer orsemi-portable computer, a desktop computing device, a terminal computingdevice or other semi-stationary or stationary computing device, adedicated device, a wearable computing device or other body-mountedcomputing device, an augmented reality device, a virtual reality device,an Internet of Things (IoT) device, etc. That is, the user device 1702can be any computing device capable of sending communications andperforming the functions according to the techniques described herein.The user device 1702 can include devices, e.g., payment card readers, orcomponents capable of accepting payments, as described below.

In the illustrated example, the user device 1702 includes one or moreprocessors 1708, one or more computer-readable media 1710, one or morecommunication interface(s) 1712, one or more input/output (I/O) devices1714, a display 1716, and sensor(s) 1718.

In some embodiments, each processor 1708 can itself comprise one or moreprocessors or processing cores. For example, the processor(s) 1708 canbe implemented as one or more microprocessors, microcomputers,microcontrollers, digital signal processors, central processing units,state machines, logic circuitries, and/or any devices that manipulatesignals based on operational instructions. In some examples, theprocessor(s) 1708 can be one or more hardware processors and/or logiccircuits of any suitable type specifically programmed or configured toexecute the algorithms and processes described herein. The processor(s)1708 can be configured to fetch and execute computer-readableprocessor-executable instructions stored in the computer-readable media1710.

Depending on the configuration of the user device 1702, thecomputer-readable media 1710 can be an example of tangiblenon-transitory computer storage media and can include volatile andnonvolatile memory and/or removable and non-removable media implementedin any type of technology for storage of information such ascomputer-readable processor-executable instructions, data structures,program components or other data. The computer-readable media 1710 caninclude, but is not limited to, RAM, ROM, EEPROM, flash memory,solid-state storage, magnetic disk storage, optical storage, and/orother computer-readable media technology. Further, in some examples, theuser device 1702 can access external storage, such as RAID storagesystems, storage arrays, network attached storage, storage areanetworks, cloud storage, or any other medium that can be used to storeinformation and that can be accessed by the processor(s) 1708 directlyor through another computing device or network. Accordingly, thecomputer-readable media 1710 can be computer storage media able to storeinstructions, components or components that can be executed by theprocessor(s) 1708. Further, when mentioned, non-transitorycomputer-readable media exclude media such as energy, carrier signals,electromagnetic waves, and signals per se.

The computer-readable media 1710 can be used to store and maintain anynumber of functional components that are executable by the processor(s)1708. In some implementations, these functional components compriseinstructions or programs that are executable by the processor(s) 1708and that, when executed, implement operational logic for performing theactions and services attributed above to the user device 1702.Functional components stored in the computer-readable media 1710 caninclude a multi-media application 1720 that can include a user interfaceto enable users to interact with the user device 1702, and thus theserver(s) 1704 and/or other networked devices. In some embodiments, themulti-media application 1720 can be presented via a web browser, or thelike. In some embodiments, the 1720 is the multi-media application 106,such as a mobile application or desktop application, which can beprovided by multi-media platform 108 associated with the server(s) 1704,or which can be an otherwise dedicated application. In some examples,the multi-media application 1720 can display the user interfacesdescribed above with reference to FIG. 6A-FIG. 6B, FIG. 9A-FIG. 9D, FIG.13 , FIG. 14 , FIG. 15A, FIG. 15B, FIG. 16A and FIG. 16E. In someembodiments, the user interface 1702 can present a consolidatedcommunication user interface, or portion thereof. In some embodiments, auser can interact with the user interface via touch input, spoken input,gesture, or any other type of input. The word “input” is also used todescribe “contextual” input that may not be directly provided by theuser via the user interface. For example, user's interactions with theuser interface are analyzed using, e.g., natural language processingtechniques, to determine context or intent of the user, which may betreated in a manner similar to “direct” user input.

Depending on the type of the user device 1702, the computer-readablemedia 1710 can also optionally include other functional components anddata, such as other components and data 1722, which can includeprograms, drivers, etc., and the data used or generated by thefunctional components. In addition, the computer-readable media 1710 canalso store data, data structures and the like, that are used by thefunctional components. Further, the user device 1702 can include manyother logical, programmatic and physical components, of which thosedescribed are merely examples that are related to the discussion herein.

In some embodiments, the computer-readable media 1710 can includeadditional functional components, such as an operating system 1724 forcontrolling and managing various functions of the user device 1702 andfor enabling basic user interactions.

The communication interface(s) 1712 can include one or more interfacesand hardware components for enabling communication with various otherdevices, such as over the network(s) 1706 or directly. For example,communication interface(s) 1712 can enable communication through one ormore network(s) 1706, which can include, but are not limited any type ofnetwork known in the art, such as a local area network or a wide areanetwork, such as the Internet, and can include a wireless network, suchas a cellular network, a cloud network, a local wireless network, suchas Wi-Fi and/or close-range wireless communications, such as Bluetooth®,BLE, NFC, RFID, a wired network, or any other such network, or anycombination thereof. Accordingly, network(s) 1706 can include both wiredand/or wireless communication technologies, including Bluetooth®, BLE,Wi-Fi and cellular communication technologies, as well as wired or fiberoptic technologies. Components used for such communications can dependat least in part upon the type of network, the environment selected, orboth. Protocols for communicating over such networks are well known andwill not be discussed herein in detail.

Embodiments of the disclosure may be provided to users through a cloudcomputing infrastructure. Cloud computing refers to the provision ofscalable computing resources as a service over a network, to enableconvenient, on-demand network access to a shared pool of configurablecomputing resources that can be rapidly provisioned and released withminimal management effort or service provider interaction. Thus, cloudcomputing allows a user to access virtual computing resources (e.g.,storage, data, applications, and even complete virtualized computingsystems) in “the cloud,” without regard for the underlying physicalsystems (or locations of those systems) used to provide the computingresources.

The user device 1702 can further include one or more input/output (I/O)devices 1714. The I/O devices 1714 can include speakers, a microphone, acamera, and various user controls (e.g., buttons, a joystick, akeyboard, a keypad, etc.), a haptic output device, and so forth. The I/Odevices 1714 can also include attachments that leverage the accessories(audio-jack, USB-C, Bluetooth, etc.) to connect with the user device1702.

In some embodiments, user device 1702 can include a display 1716.Depending on the type of computing device(s) used as the user device1702, the display 1716 can employ any suitable display technology. Forexample, the display 1716 can be a liquid crystal display, a plasmadisplay, a light emitting diode display, an OLED (organic light-emittingdiode) display, an electronic paper display, or any other suitable typeof display able to present digital content thereon. In some embodiments,the display 1716 can be an augmented reality display, a virtuallyreality display, or any other display able to present and/or projectdigital content. In some examples, the display 1716 can have a touchsensor associated with the display 1716 to provide a touchscreen displayconfigured to receive touch inputs for enabling interaction with agraphic interface presented on the display 1716. Accordingly,implementations herein are not limited to any particular displaytechnology. Alternatively, in some examples, the user device 1702 maynot include the display 1716, and information can be presented by othermeans, such as aurally, haptically, etc.

In addition, the user device 1702 can include sensor(s) 1718. Thesensor(s) 1718 can include a GPS device able to indicate locationinformation. Further, the sensor(s) 1718 can include, but are notlimited to, an accelerometer, gyroscope, compass, proximity sensor,camera, microphone, and/or a switch.

In some example, the GPS device can be used to identify a location of auser. In some embodiments, the location of the user can be used by theservice provider 712, described above, to provide one or more services.That is, in some examples, the service provider 712 can implementgeofencing to provide particular services to users. As an example, witha lending service, location can be used to confirm that a stated purposeof a loan corresponds to evidence of use (e.g., Is the user using theloan consistent with what he or she said he or she was going to use itfor?). Furthermore, in some examples, location can be used for payrollpurposes. As an example, if a contractor completes a project, thecontractor can provide a geo-tagged image (e.g., tagged based onlocation information availed by the GPS device). In some examples,location can be used for facilitating peer-to-peer payments betweennearby users 714 and/or for sending users 714 notifications regardingavailable appointments with user(s) located proximate to the users 714.In some embodiments, location can be used for taking payments fromnearby customers when they leave a geofence, or location can be used toinitiate an action responsive to users 714 enter a brick-and-mortarstore of a user. Location can be used in additional or alternative waysas well.

Additionally, the user device 1702 can include various other componentsthat are not shown, examples of which include removable storage, a powersource, such as a battery and power control unit, a barcode scanner, aprinter, a cash drawer, and so forth.

In addition, in some examples, the user device 1702 can include, beconnectable to, or otherwise be coupled to a reader device 1726, forreading payment instruments and/or identifiers associated with paymentobjects. In some examples, as described above, the reader device 1726can plug in to a port in the user device 1702, such as a microphoneport, a headphone port, an audio-jack, a data port, or other suitableport. In additional or alternative examples, the reader device 1726 canbe coupled to the user device 1702 via another wired or wirelessconnection, such as via a Bluetooth®, BLE, and so on. The reader device1726 can include a read head for reading a magnetic strip of a paymentcard, and further can include encryption technology for encrypting theinformation read from the magnetic strip. Additionally or alternatively,the reader device 1726 can be an EMV payment reader, which in someexamples, can be embedded in the user device 1702. Moreover, numerousother types of readers can be employed with the user device 1702 herein,depending on the type and configuration of the user device 1702.

The reader device 1726 may be a portable magnetic stripe card reader,optical scanner, smartcard (card with an embedded IC chip) reader (e.g.,an EMV-compliant card reader or short-range communication-enabledreader), RFID reader, or the like, configured to detect and obtain dataoff any payment instrument. Accordingly, the reader device 1726 mayinclude hardware implementation, such as slots, magnetic tracks, andrails with one or more sensors or electrical contacts to facilitatedetection and acceptance of a payment instrument. That is, the readerdevice 1726 may include hardware implementations to enable the readerdevice 1726 to interact with a payment instrument via a swipe (i.e., acard-present transaction where a customer slides a card having amagnetic strip through a payment reader that captures payment datacontained in the magnetic strip), a dip (i.e., a card-presenttransaction where a customer inserts a card having an embedded microchip(i.e., chip) into a payment reader first until the payment readerprompts the customer to remove the card), or a tap (i.e., a card-presenttransaction where a customer may tap or hover his or her electronicdevice such as a smart phone running a payment application over apayment reader to complete a transaction via short-range communication)to obtain payment data associated with a customer. Additionally oroptionally, the reader device 1726 may also include a biometric sensorto receive and process biometric characteristics and process them aspayment instruments, given that such biometric characteristics areregistered with the payment service system 100 and connected to afinancial account with a bank server.

The reader device 1726 may include processing unit(s), computer-readablemedia, a reader chip, a transaction chip, a timer, a clock, a networkinterface, a power supply, and so on. The processing unit(s) of thereader device 1726 may execute one or more components and/or processesto cause the reader device 1726 to perform a variety of functions, asset forth above and explained in further detail in the followingdisclosure. In some examples, the processing unit(s) may include acentral processing unit (CPU), a graphics processing unit (GPU), a CPUand a GPU, or processing units or components known in the art.Additionally, each of the processing unit(s) may possess its own localmemory, which also may store program components, program data, and/orone or more operating systems. Depending on the exact configuration andtype of the reader device 1726, the computer-readable media may includevolatile memory (such as RAM), non-volatile memory (such as ROM, flashmemory, miniature hard drive, memory card, or the like), or somecombination thereof. In some embodiments, the computer-readable media ofthe reader device 1726 may include at least one component for performingvarious functions as described herein.

The reader chip may perform functionalities to control the operationsand processing of the reader device 1726. That is, the reader chip mayperform functionalities to control payment interfaces (e.g., acontactless interface, a contact interface, etc.), a wirelesscommunication interface, a wired interface, a user interface (e.g., asignal condition device (FPGA)), etc. Additionally, the reader chip mayperform functionality to control the timer, which may provide a timersignal indicating an amount of time that has lapsed following aparticular event (e.g., an interaction, a power-down event, etc.).Moreover, the reader chip may perform functionality to control the clock1712, which may provide a clock signal indicating a time. Furthermore,the reader chip may perform functionality to control the networkinterface, which may interface with the network(s) 1706, as describedbelow.

Additionally, the reader chip may perform functionality to control thepower supply. The power supply may include one or more power suppliessuch as a physical connection to AC power or a battery. Power supply mayinclude power conversion circuitry for converting AC power andgenerating a plurality of DC voltages for use by components of readerdevice 1726. When power supply includes a battery, the battery may becharged via a physical power connection, via inductive charging, or viaany other suitable method.

The transaction chip may perform functionalities relating to processingof payment transactions, interfacing with payment instruments,cryptography, and other payment-specific functionality. That is, thetransaction chip may access payment data associated with a paymentinstrument and may provide the payment data to a POS terminal, asdescribed above. The payment data may include, but is not limited to, aname of the customer, an address of the customer, a type (e.g., credit,debit, etc.) of a payment instrument, a number associated with thepayment instrument, a verification value (e.g., PIN Verification KeyIndicator (PVKI), PIN Verification Value (PVV), Card Verification Value(CVV), Card Verification Code (CVC), etc.) associated with the paymentinstrument, an expiration data associated with the payment instrument, aprimary account number (PAN) corresponding to the customer (which may ormay not match the number associated with the payment instrument),restrictions on what types of charges/debts may be made, etc.Additionally, the transaction chip may encrypt the payment data uponreceiving the payment data.

It should be understood that in some examples, the reader chip may haveits own processing unit(s) and computer-readable media and/or thetransaction chip may have its own processing unit(s) andcomputer-readable media. In other examples, the functionalities ofreader chip and transaction chip may be embodied in a single chip or aplurality of chips, each including any suitable combination ofprocessing units and computer-readable media to collectively perform thefunctionalities of reader chip and transaction chip as described herein.

While, the user device 1702, which can be a POS terminal, and the readerdevice 1726 are shown as separate devices, in additional or alternativeexamples, the user device 1702 and the reader device 1726 can be part ofa single device, which may be a battery-operated device. In such anexample, components of both the user device 1702 and the reader device1726 may be associated with the single device. In some examples, thereader device 1726 can have a display integrated therewith, which can bein addition to (or as an alternative of) the display 1716 associatedwith the user device 1702.

The server(s) 1704 can include one or more servers or other types ofcomputing devices that can be embodied in any number of ways. Forexample, in the example of a server, the components, other functionalcomponents, and data can be implemented on a single server, a cluster ofservers, a server farm or data center, a cloud-hosted computing service,a cloud-hosted storage service, and so forth, although other computerarchitectures can additionally or alternatively be used.

Further, while the figures illustrate the components and data of theserver(s) 1704 as being present in a single location, these componentsand data can alternatively be distributed across different computingdevices and different locations in any manner. Consequently, thefunctions can be implemented by one or more server computing devices,with the various functionality described above distributed in variousways across the different computing devices. Multiple server(s) 1704 canbe located together or separately, and organized, for example, asvirtual servers, server banks and/or server farms. The describedfunctionality can be provided by the servers of a single user orenterprise, or can be provided by the servers and/or services ofmultiple different customers or enterprises.

In the illustrated example, the server(s) 1704 can include one or moreprocessors 1728, one or more computer-readable media 1730, one or moreI/O devices 1732, and one or more communication interfaces 1734. Eachprocessor 1728 can be a single processing unit or a number of processingunits, and can include single or multiple computing units or multipleprocessing cores. The processor(s) 1728 can be implemented as one ormore microprocessors, microcomputers, microcontrollers, digital signalprocessors, central processing units, state machines, logic circuitries,and/or any devices that manipulate signals based on operationalinstructions. For example, the processor(s) 1728 can be one or morehardware processors and/or logic circuits of any suitable typespecifically programmed or configured to execute the algorithms andprocesses described herein. The processor(s) 1728 can be configured tofetch and execute computer-readable instructions stored in thecomputer-readable media 1730, which can program the processor(s) 1728 toperform the functions described herein.

The computer-readable media 1730 can include volatile and nonvolatilememory and/or removable and non-removable media implemented in any typeof technology for storage of information, such as computer-readableinstructions, data structures, program components, or other data. Suchcomputer-readable media 1730 can include, but is not limited to, RAM,ROM, EEPROM, flash memory or other memory technology, optical storage,solid state storage, magnetic tape, magnetic disk storage, RAID storagesystems, storage arrays, network attached storage, storage areanetworks, cloud storage, or any other medium that can be used to storethe desired information and that can be accessed by a computing device.Depending on the configuration of the server(s) 1704, thecomputer-readable media 1730 can be a type of computer-readable storagemedia and/or can be a tangible non-transitory media to the extent thatwhen mentioned, non-transitory computer-readable media exclude mediasuch as energy, carrier signals, electromagnetic waves, and signals perse.

The computer-readable media 1730 can be used to store any number offunctional components that are executable by the processor(s) 1728. Inmany implementations, these functional components comprise instructionsor programs that are executable by the processors 1728 and that, whenexecuted, specifically configure the one or more processors 1728 toperform the actions attributed above to the service provider 712 and/orpayment processing service. Functional components stored in thecomputer-readable media 1730 can optionally include a media managementcomponent 1736, which can include a context determination component1738, a training component 1740, one or more other components and data1742, and an operating system 1744.

The functionality of the media management component 1736, the contextdetermination component 1738, and the training component 1740 aredescribed above with reference to the multi-media platform 108, thecontext determination component 226, and the machine learning component228 of FIG. 2 .

The one or more other components and data 1742 can include a usercomponent. The user component can be configured to receive transactiondata from POS systems, such as the POS system 624 described above withreference to FIG. 6 . The user component can transmit requests (e.g.,authorization, capture, settlement, etc.) to payment service servercomputing device(s) to facilitate POS transactions between users andcustomers. The user component can communicate the successes or failuresof payments associated with the POS transactions to the POS systems.Further, the one or more other components and data 1742 can includeprograms, drivers, etc., and the data used or generated by thefunctional components. Further, the server(s) 1704 can include manyother logical, programmatic and physical components, of which thosedescribed above are merely examples that are related to the discussionherein.

The one or more “components” referenced herein may be implemented asmore components or as fewer components, and functions described for thecomponents may be redistributed depending on the details of theimplementation. The term “component,” as used herein, refers broadly tosoftware stored on non-transitory storage medium (e.g., volatile ornon-volatile memory for a computing device), hardware, or firmware (orany combination thereof) components. Modules are typically functionalsuch that they that may generate useful data or other output usingspecified input(s). A component may or may not be self-contained. Anapplication program (also called an “application”) may include one ormore components, or a component may include one or more applicationprograms that can be accessed over a network or downloaded as softwareonto a device (e.g., executable code causing the device to perform anaction). An application program (also called an “application”) mayinclude one or more components, or a component may include one or moreapplication programs. In additional and/or alternative examples, thecomponent(s) may be implemented as computer-readable instructions,various data structures, and so forth via at least one processing unitto configure the computing device(s) described herein to executeinstructions and to perform operations as described herein.

In some examples, a component may include one or more applicationprogramming interfaces (APIs) to perform some or all of itsfunctionality (e.g., operations). In some embodiments, a softwaredeveloper kit (SDK) can be provided by the service provider to allowthird-party developers to include service provider functionality and/oravail service provider services in association with their ownthird-party applications. Additionally or alternatively, in someexamples, the service provider can utilize a SDK to integratethird-party service provider functionality into its applications. Thatis, API(s) and/or SDK(s) can enable third-party developers to customizehow their respective third-party applications interact with the serviceprovider or vice versa. Further, SDK(s) and/or API(s) can be used byvarious platforms/services to enable the various platforms/services(first-party or third-party) to send and/or receive messages viatechniques described herein.

The computer-readable media 1730 can additionally include an operatingsystem 1744 for controlling and managing various functions of theserver(s) 1704.

The communication interface(s) 1734 can include one or more interfacesand hardware components for enabling communication with various otherdevices, such as over the network(s) 1706 or directly. For example,communication interface(s) 1734 can enable communication through one ormore network(s) 1706, which can include, but are not limited any type ofnetwork known in the art, such as a local area network or a wide areanetwork, such as the Internet, and can include a wireless network, suchas a cellular network, a local wireless network, such as Wi-Fi and/orclose-range wireless communications, such as Bluetooth®, BLE, NFC, RFID,a wired network, or any other such network, or any combination thereof.Accordingly, network(s) 1702 can include both wired and/or wirelesscommunication technologies, including Bluetooth®, BLE, Wi-Fi andcellular communication technologies, as well as wired or fiber optictechnologies. Components used for such communications can depend atleast in part upon the type of network, the environment selected, orboth. Protocols for communicating over such networks are well known andwill not be discussed herein in detail.

The server(s) 1704 can further be equipped with various I/O devices1732. Such I/O devices 1732 can include a display, various userinterface controls (e.g., buttons, joystick, keyboard, mouse, touchscreen, biometric or sensory input devices, etc.), audio speakers,connection ports and so forth.

In some embodiments, the system can include data store(s) 1746 that canbe configured to store data that is accessible, manageable, andupdatable. In some examples, the data store(s) 1746 can be integratedwith the user device 1702 and/or the server(s) 1704. In other examples,as shown in FIG. 17 , the data store(s) 1746 can be located remotelyfrom the server(s) 1704 and can be accessible to the server(s) 1704. Thedata store(s) 1746 can comprise multiple databases and/or serversconnected locally and/or remotely via the network(s) 1706. In someembodiments, the data store(s) 1746 can correspond to the data store(s)114, which are described above as storing user profiles, permission(s),rule(s), and/or the like. In some embodiments, the data store(s) 1746can store inventory database(s) and/or catalog database(s), messagingdatabase(s), and/or the like. As described above, an inventory databasecan store data associated with a quantity of each media content that auser has available to the user. Furthermore, a catalog database canstore data associated with items that a user has available foracquisition. A communication database can store communications and/orother communications exchanged via the service provider. The datastore(s) 1746 can store additional or alternative types of data asdescribed herein.

The phrases “in some examples,” “according to various examples,” “in theexamples shown,” “In some embodiments,” “in other examples,” “variousexamples,” “some examples,” and the like generally mean the particularfeature, structure, or characteristic following the phrase is includedin some embodiments of the present invention, and may be included inmore than one example of the present invention. In addition, suchphrases do not necessarily refer to the same examples or to differentexamples.

If the specification states a component or feature “can,” “may,”“could,” or “might” be included or have a characteristic, thatparticular component or feature is not required to be included or havethe characteristic.

Further, the aforementioned description is directed to devices andapplications that are related to payment technology. However, it will beunderstood, that the technology can be extended to any device andapplication. Moreover, techniques described herein can be configured tooperate irrespective of the kind of payment object reader, POS terminal,web applications, mobile applications, POS topologies, payment cards,computer networks, and environments.

For clarity of explanation, in some instances, the present technologymay be presented as including individual functional blocks includingfunctional blocks comprising devices, device components, steps orroutines in a method embodied in software, or combinations of hardwareand software.

Any of the steps, operations, functions, or processes described hereinmay be performed or implemented by a combination of hardware andsoftware services or services, alone or in combination with otherdevices. In some embodiments, a service can be software that resides inmemory of a client device and/or one or more servers of a contentmanagement system and perform one or more functions when a processorexecutes the software associated with the service. In some embodiments,a service is a program or a collection of programs that carry out aspecific function. In some embodiments, a service can be considered aserver. The memory can be a non-transitory computer-readable medium.

In some embodiments, the computer-readable storage devices, mediums, andmemories can include a cable or wireless signal containing a bit streamand the like. However, when mentioned, non-transitory computer-readablestorage media expressly exclude media such as energy, carrier signals,electromagnetic waves, and signals per se.

Methods according to the above-described examples can be implementedusing computer-executable instructions that are stored or otherwiseavailable from computer-readable media. Such instructions can comprise,for example, instructions and data which cause or otherwise configure ageneral purpose computer, special purpose computer, or special purposeprocessing device to perform a certain function or group of functions.Portions of computer resources used can be accessible over a network.The executable computer instructions may be, for example, binaries,intermediate format instructions such as assembly language, firmware, orsource code. Examples of computer-readable media that may be used tostore instructions, information used, and/or information created duringmethods according to described examples include magnetic or opticaldisks, solid-state memory devices, flash memory, USB devices providedwith non-volatile memory, networked storage devices, and so on.

Devices implementing methods according to these disclosures can comprisehardware, firmware and/or software, and can take any of a variety ofform factors. Typical examples of such form factors include servers,laptops, smartphones, small form factor personal computers, personaldigital assistants, and so on. The functionality described herein alsocan be embodied in peripherals or add-in cards. Such functionality canalso be implemented on a circuit board among different chips ordifferent processes executing in a single device, by way of furtherexample.

The instructions, media for conveying such instructions, computingresources for executing them, and other structures for supporting suchcomputing resources are means for providing the functions described inthese disclosures.

Aspects of the present technology:

Aspect 1. A method of facilitating a live playback stream by amulti-media platform, the multi-media platform hosting a plurality ofmulti-media content, the method comprising: receiving an instruction toinitiate a live playback stream over the Internet, wherein the clientdevice controls public playback of media content from a client deviceand is a source of commentary during the live playback stream;initiating at least two streams between the client device and themulti-media platform, wherein one stream is a playback control channelbetween the multi-media platform and the client device for transmittingdata regarding playback controls pertaining to media content and anotherstream is a live media stream for transmitting data encoding livecommentary; hosting the live playback stream over the Internet bytransmitting at least a portion of the data from the playback controlchannel and the live media stream to a connecting client device.

Aspect 2. The method of Aspect 1, further comprising: receiving dataidentifying media content in at least a portion of an up next queue fromthe client device, the up next queue including at least one mediacontent planned for playback during the live playback stream; for eachaudience member client device, sending the data identifying mediacontent, whereby the client devices can determine whether any of theidentified media content are already stored or cached at the clientdevice, and request the media content not stored on the client devicefrom the multi-media platform.

Aspect 3. The method of any of Aspects 1 to 2, wherein the data encodinglive commentary in the live media stream is audio captured by amicrophone of the client device.

Aspect 4. The method of any of Aspects 1 to 3, wherein the playbackcontrol channel includes multiplexing information that maps the audiocaptured by the microphone to a time-domain associated with a currentlyplaying media content.

Aspect 5. The method of any of Aspects 1 to 4, wherein the live mediastream can include audio or audio-video media.

Aspect 6. The method of any of Aspects 1 to 5, wherein the audiocaptured by the microphone and the currently playing media content aremultiplexed using data from the playback control channel on an instanceof the multi-media application running on user device of a user accountconnected to the live playback stream.

Aspect 7. The method of any of Aspects 1 to 6, wherein the dataregarding playback controls of the playback control channel includesplayback synchronization information for the playback of the mediacontent such as play, skip, pause commands.

Aspect 8. The method of any of Aspects 1 to 7, further comprising:multiplexing, at the multi-media platform, audio data for a mediacontent with the live commentary; and transmitting a single combinedmedia stream including the media content for live playback with the livecommentary.

Aspect 9. The method of any of Aspects 1 to 8, wherein the playbackcontrol channel includes data describing custom mixing or transitions toapply to media content in the portion of the up next queue.

Aspect 10. The method of any of Aspects 1 to 9, further comprising:receiving an identification of specified user account(s) to join thelive playback stream; and inviting the specified user account(s) toconnect to the live playback stream.

Aspect 11. The method of any of Aspects 1 to 10, further comprising:collecting metrics regarding user accounts connected to the liveplayback stream; sending real-time listener data including at least auser name and at least one statistic regarding engagement by arespective real-time listener to the user account controlling thebroadcast.

Aspect 12. The method of any of Aspects 1 to 11, further comprising:receiving a request to join the live playback stream as asecondary-host, wherein the request to join the live playback stream asthe secondary-host includes a token identifying the live playback steamand a rights object issued by either the client device of a primary hostof the playback stream or the multi-media platform; initiating asecondary-host live media stream with the secondary host; receivingcommentary from the secondary host and transmitting it to the primaryhost and to the audience member client device.

Aspect 13. The method of any of Aspects 1 to 12, further comprising:receiving an instruction from the primary host to terminate thesecondary-host live media stream.

Aspect 14. The method of any of Aspects 1 to 13, wherein the multi-mediaapplication is associated with a multi-media platform, the multi-mediaplatform including a plurality of user accounts, the user accountsincluding general user accounts, and artist account, the methodcomprising: receiving a user interface input to send a notificationannouncing a live playback stream; determining whether the user accountis one of the verified artist user accounts; sending the notificationannouncing the live playback stream only to user accounts that followthe user account, and over social media channels linked to the useraccount.

Aspect 15. The method of any of Aspects 1 to 14, further comprising:providing at least one content for acquisition by a user of the audiencemember client device, the content for acquisition to be displayed as anactionable link in a user interface at the connecting device; receivinga request from the audience member client device as a result ofactuation of the actionable link by the user of the audience memberclient device; redirecting the audience member client device to a storepage of a host of the live playback stream, wherein the store page ofthe host of the live playback stream includes the at least one contentfor acquisition.

Aspect 16. The method of any of Aspects 1 to 15, further comprising:receiving from an e-commerce service reporting data indicating that theuser of the connecting device acquired the at least one content foracquisition.

Aspect 17. The method of any of Aspects 1 to 16, further comprising:performing natural language processing on the live media stream;detecting a statement in the live media stream informing the user of theaudience member client device of a purchase opportunity; providing alink for providing at least one content for acquisition by a user of theaudience member client device corresponding to the purchase opportunity,wherein the at least one content for acquisition includes tickets to alive show, a media content, merchandise, etc.

Aspect 18. The method of any of Aspects 1 to 17, further comprising:determining that there are different segments of audience membersconnected to the live playback stream including the first segment ofuser accounts and the second segment of user accounts; whereby thedifferent segments of the audience members are connected to differentinstances of the live performance of the broadcast.

Aspect 19. The method of any of Aspects 1 to 18, further comprising:receiving a communication from one of the audience members connected tothe second instance of the live playback stream; broadcasting thereceived communication all other audience members connected to thesecond instance of the live playback stream including a broadcaster thatis the source of the live playback stream.

Aspect 20. A method of producing a live playback stream by a multi-mediaapplication associated with user account of a multi-media platform, themethod comprising: presenting a queue of media content and a liveplayback stream control user interface button in the multi-mediaapplication, wherein the queue of media content is a list of audio orvideo media content to be played; receiving a selection of the liveplayback stream control user interface button, wherein the live playbackstream control user interface button is configured to reversibly switchbetween a personalized playback mode and a public playback mode;responsive to receiving the selection of the broadcast control userinterface button switching from the personalized playback mode to thepublic playback mode, wherein in the public playback mode the clientdevice controls public playback of media content and is a source ofcommentary during the live playback stream; sending an instruction toinitiate a live playback stream over the Internet to the multi-mediaplatform; initiating at least two streams between the multi-mediaapplication and the multi-media platform, wherein one stream is aplayback control channel and another stream is a live media stream fortransmitting data encoding live commentary, wherein the playback controlchannel is for transmitting an identification of a least a portion ofthe media content in the queue of media content and data regardingplayback controls pertaining to the media content.

Aspect 21. The method of Aspect 20, further comprising: capturing thecommentary by a microphone on the client device executing themulti-media application; transmitting the data encoding live commentaryas part of the live media stream.

Aspect 22. The method of any of Aspects 20 to 21, further comprising:transmitting time domain information to map the commentary captured bythe microphone to a time-domain associated with a currently playingmedia content over the playback control channel.

Aspect 23. The method of any of Aspects 20 to 22, further comprising:after receiving the selection of the live playback stream control userinterface button switching from the personalized playback mode to thepublic playback mode; determining that a shuffle option is enabled inthe multi-media application; disabling the shuffle option.

Aspect 24. The method of any of Aspects 20 to 23, wherein the queue ofmedia content in the multi-media application is two different queues,the two different queues include a broadcast queue and a personallistening queue, the method further comprising: while playing back mediacontent in the personal listening queue receiving inputs to add mediacontent and transitions to the live playback queue for playback duringwhen the multi-media application is in the public playback mode.

Aspect 25. A method of connecting to a live playback stream provided bya multi-media platform by an audience member client device, wherein themulti-media platform is a source of multi-media content to be playedduring the live playback stream while a host user device is a source ofcommentary provided during the live playback stream, the methodcomprising: initiating at least two streams between the audience memberclient device and the multi-media platform, wherein one stream is aplayback control channel and another stream is a live media stream,wherein the live media stream for transmitting data encoding livecommentary, wherein the playback control channel is for transmitting anidentification of a least a portion of the media content in a queue ofmedia content and data regarding playback controls pertaining to themedia content; determining whether any of the media content in the queueof media content identified using the playback control panel are cachedby the audience member client device, wherein when the media content arecached at the client device, the connecting client plays the mediacontent from its cache as instructed by the playback control channel;when the media content are not cached at the client device, requestingthe media content from the multi-media platform prior receiving aninstruction to play the media content by the playback control channel.

Aspect 26. The method of Aspect 25, further comprising: multiplexing thecommentary encoded in the live media stream with a currently playingmedia content using multiplexing information and playback stateinformation received over the playback control channel on the audiencemember client device connected to the live playback stream.

Aspect 27. The method of any of Aspects 25 to 26, further comprising:receiving a link for providing at least one content for acquisition;displaying the content for acquisition as an actionable link in a userinterface; receiving a selection of actionable link by the user of theaudience member client device; requesting a store page of a host of thelive playback stream, wherein the store page of the host of the liveplayback stream includes the at least one content for acquisition.

Aspect 28. The method of any of Aspects 25 to 27, wherein the store pageis hosted by an e-commerce platform.

Aspect 29. A method comprising: hosting a live playback stream over theInternet by transmitting data from a playback control channel and a livemedia stream to one or more connecting client devices; providing a firstaudience member engagement experience and a second audience memberengagement experience, wherein a first audience member engagementexperience provides a first segment of user accounts with limitedengagement options, wherein the second audience member engagementexperience provides a second segment of user accounts with additionalengagement options.

Aspect 30. The method of Aspect 29, wherein the second segment of useraccounts are part of a superfan segment that includes superfans of abroadcaster that is the source of the live playback stream, wherein theadditional user engagement options include options to send chat messagesto the broadcaster, to send voice recordings to the broadcaster, etc.

Aspect 31. The method of any of Aspects 29 to 30, further comprising:collecting information associated with user accounts, the informationincludes media content preference information, social channelinformation, and/or purchase information, the media content preferenceinformation derived from explicit data provided by user inputsindicating an affinity for an artist or a media content, and implicitdata such playback engagement data including skip counts, play counts,and purchases; the social channel information received from one or moresocial platforms, the social channel information can include friends andfollower information, topic engagement, and content engagement, and thepurchase information received from one or more payment networks, thepayment information indicating spending pertaining to engagement withmedia content or artists.

Aspect 32. The method of any of Aspects 29 to 31, further comprising:analyzing the information associated with the user accounts to generatethe media content preference information including one orrepresentations of an affinity of a user of a user account for a mediacontent.

Aspect 33. The method of any of Aspects 29 to 32, further comprising:determining that a past live playback stream from a user account had apopularity above a threshold; comparing a media content preference ofthe user account with other user accounts to identify other useraccounts with similar media content preferences; sending thenotification announcing the live playback stream to the other useraccounts with the similar media content preferences.

Aspect 34. The method of any of Aspects 29 to 33, further comprising:determining that a past live playback stream from a user account had apopularity above a threshold; comparing the media content in the queueof media content with media content preferences of other user accountsto identify other user accounts whose media content preferences indicatethat would enjoy joining the live playback stream; sending thenotification announcing the live playback stream to the other useraccounts whose media content preferences indicate that would enjoyjoining the live playback stream.

Aspect 35. The method of any of Aspects 29 to 34, further comprising;analyzing the information associated with the user accounts to generatean artist affinity profile, the artist affinity profile including ascore of an affinity for a particular artist for a user of a useraccount.

Aspect 36. The method of any of Aspects 29 to 35, further comprising:comparing scores in the artist affinity profiles in respective useraccounts; determining user accounts from the population of user accountshaving the strongest affinity for the particular artist; inviting theuser accounts from the population of user accounts having the strongestaffinity for the particular artist to an event hosted by the artist.

Aspect 37. The method of any of Aspects 29 to 36, wherein the eventhosted by the artist is a live playback stream.

Aspect 38. The method of any of Aspects 29 to 37, further comprising:creating a mailing list for the particular artist from the user accountsfrom the population of user accounts having the strongest affinity forthe particular artist; sharing the mailing list with a user account forthe particular artist, wherein the user account for the particularartist is a verified user account, wherein data from the mailing listthat identifies the user accounts in the mailing list by an anonymous IDor by a public user name is shared with the particular artist, butcontact information and personal identifying information is not sharedwith the particular artist.

Aspect 39. The method of any of Aspects 29 to 38, further comprising:receiving an input from the verified user account of the artist to senda notification to the mailing list; sending the notification to the useraccounts on the mailing list, the notification being sent to the usersof the user accounts using a communication channel preference storedwith respect to the user account.

Aspect 40. The method of any of Aspects 29 to 39, wherein thenotification includes a security token, the method comprising: receivinga request to access the event; determining whether the request includesevidence of the received security token; sending a push notification toa MFA method to provide secondary authentication of the user accountprior to allowing the user access to the event.

Aspect 41. The method of any of Aspects 29 to 40, wherein the eventhosted by the artist is a live chat or video conference.

Aspect 42. The method of any of Aspects 29 to 41, wherein the eventtakes place outside of the multi-media platform such as a social mediaplatform, video conferencing platform, chat platform, etc.

Aspect 43. A method of facilitating a live playback stream by amulti-media service, the multi-media platform hosting a plurality ofmulti-media content, the method comprising: presenting broadcastcontrols, the broadcast controls including at least an input switchingcontrol, a microphone control, a sound effects control, and listenerstatistics; responsive to receiving a selection of the microphonecontrol, presenting a mixing interface, wherein the mixing interfaceincludes a penannular slider about a microphone toggle, the penannularslider configured to accept an input to drag an indicator about thepenannular slider, wherein a first terminal end of the penannular slideris configured to cause a majority of audio to come from a microphoneinput, and a second terminal end of the penannular slider is configuredto cause a majority of audio to come from playback of the media content,and locations between the first terminal end and the second terminal endare configured to multiplex audio from the microphone source and theplayback of media content according to respective distances from each ofthe terminal ends such that the closer the indicator is to the firstterminal end the greater the volume from the microphone source comparedto the playback of media content, and the closer the indicator is to thesecond terminal end the greater the volume from the playback of mediacontent compared to the microphone source.

Aspect 44. The method of Aspect 43, further comprising: receiving aselection of the sound effects control; responsive to the selection ofthe sound effects control, presenting sampling options; receiving aselection of a sampling option from one of the sampling options;automatically mixing the sample into a currently playing media content.

Aspect 45. The method of any of Aspects 43 to 44, further comprising:receiving a selection of the sound effects control; responsive to theselection of the sound effects control, presenting crossfade options;receiving a selection of a crossfade option from one of the crossfadeoptions to be come an active crossfade option; at a transition from acurrently playing media content to a subsequent media contentautomatically applying the active crossfade option to transition fromthe end of the currently playing media content to the beginning of thesubsequent media content.

Aspect 46. The method of any of Aspects 43 to 45, further comprising:responsive to receiving a selection of the input switching control,presenting at least one option for an available input other than themicrophone and media content playback; receiving the selection of theavailable input other than the microphone and media content playback;presenting the mixing interface wherein one of the terminal ends of thepenannular slider represents the selected available input other than themicrophone and media content playback.

Aspect 47. A method for valuing at least a sample of a media content tobe valued, the method comprising: evaluating market data pertaining tothe media content, wherein the market data includes a list price andhistorical sales volume for the media content; evaluating at least onemarket trend pertaining to similar media content to the media content tobe valued, wherein the at least one market trend is charts data,critical review scores, and social media interaction with the similarmedia content; and based on the market data and the evaluation of the atleast one market trend, determining a spot price for the media contentto be valued.

Aspect 48. The method of Aspect 47, wherein the determining a spot pricefor the media content to be valued is performed by a machine learningalgorithm receiving the market data and the at least one market trend.

Aspect 49. The method of any of Aspects 47 to 49, further comprising:identifying possible samples of the media content to be valued; and forat least one of the possible samples, valuing the spot price of thepossible sample using market data for at least one similar samplepreviously licensed, wherein a similar sample is a sample of a mediacontent having similar characteristics or belonging to a similar genre,or having a similar popularity.

Aspect 50. The method of any of Aspects 47 to 50, wherein thedetermining the spot price for the media content to be valued is furtherbased on the spot price of the at least one possible sample of the mediacontent.

Aspect 51. The method of any of Aspects 47 to 51, wherein there aredifferent spot prices associated with rights for acquiring a copy of amedia content for personal playback, licensing a media content forpublic playback, licensing the media content for use of a sample of themedia content in another media content, acquiring an assignment of acopyright to control the media content.

Aspect 52. A method for managing at least a portion of a media contentusing an NFT and an associated smart contract, the method comprising:creating an NFT referencing ownership of a right associated with atleast a portion of the media content, the NFT having an associated smartcontract; storing the NFT on a blockchain network.

Aspect 53. The method of Aspect 52, wherein the smart contractreferences one or more conditions for acquiring an assignment of thecopyright to control the media content.

Aspect 54. The method of any of Aspects 52 to 53, wherein at least onecondition is an agreement to pay a spot price for the value of theassignment.

Aspect 55. The method of any of Aspects 52 to 54, wherein the smartcontract references one or more conditions for acquiring a copy of amedia content for personal playback.

Aspect 56. The method of any of Aspects 52 to 55, wherein the smartcontract references one or more conditions for licensing a media contentfor public playback.

Aspect 57. The method of any of Aspects 52 to 56, wherein the smartcontract references one or more conditions for licensing the mediacontent for use of a sample of the media content in another mediacontent.

Aspect 58. The method of any of Aspects 52 to 57, transferring a rightassociated with at least a portion of a media content that is defined bythe smart contract when the conditions of the smart contract have beensatisfied.

Aspect 59. A method of of facilitating a live playback stream by amulti-media platform, the multi-media platform hosting a plurality ofrecorded media content, wherein during the live playback stream a clientdevice of the host controls public playback of media content and is asource of commentary, the method comprising: presenting a queue of mediacontent and a live playback stream control user interface button in themulti-media application, wherein the queue of media content is a list ofaudio or video media content to be played; receiving a selection of thelive playback stream control user interface button, wherein the liveplayback stream control user interface button is configured toreversibly switch between a personalized playback mode and a publicplayback mode; responsive to receiving the selection of the broadcastcontrol user interface button switching from the personalized playbackmode to the public playback mode, wherein in the public playback modethe client device controls public playback of media content and is asource of commentary during the live playback stream; sending aninstruction to initiate a live playback stream over the Internet to themulti-media platform; receiving data identifying recorded media contentin at least a portion of an up next queue from the client device of thehost, the up next queue including at least one of the plurality of therecorded media content planned for playback during the live playbackstream; receiving the instruction to initiate the live playback streamover the Internet; initiating at least two streams between the clientdevice of the host and the multi-media platform, wherein one stream is aplayback control channel and another stream is a live media stream;receiving data over the playback control channel including dataregarding playback controls pertaining to playback of the recorded mediacontent in the at least the portion of the up next queue; receiving thedata encoding the live commentary over the live media stream; andhosting the live playback stream over the Internet by transmitting datafrom the playback control channel and the live media stream to one ormore connecting client devices; determining whether any of the mediacontent in the queue of media content identified using the playbackcontrol panel are cached by the audience member client device, whereinwhen the media content are cached at the client device, the connectingclient plays the media content from its cache as instructed by theplayback control channel; when the media content are not cached at theclient device, requesting the media content from the multi-mediaplatform prior receiving an instruction to play the media content by theplayback control channel; multiplexing the commentary encoded in thelive media stream with a currently playing media content usingmultiplexing information and playback state information received overthe playback control channel on the audience member client deviceconnected to the live playback stream.

Aspect 60. A method of recommending an item to purchase associated withmedia content, the method comprising: storing metadata associated withitems of media content, the metadata comprising one or more analyticaland descriptive data describing at least one of a tempo, genre, or moodof the media content, user information and artist information; duringplayback of a media stream which includes a selection of the mediacontent, from the media server to a media device, evaluating in realtime/near real time during a period of play, at least one of: themetadata associated with the particular items of media content that arebeing provided in the media stream to the media device, or a contextassociated with the media device or the user thereof; using anevaluation of the at least one of the metadata or context, recommendingan associated item to purchase; and sending a link to allow purchase.

Aspect 61. A method, implemented at least in part by a server computingdevice of a service provider, the method comprising: receiving, from acomputing device of a first customer, a first communication for afinancial offer for generating media content via a first communicationchannel; determining context data associated with the firstcommunication, wherein context data includes data related to usage ofmedia content; receiving, by a payment processing system, from aplurality of customers, information of revenue and/or rights associatedwith other media content, wherein other media content is comparable tothe media content; generating, using one or more trained machinelearning classifiers, a request to a plurality of financial systems, theone or more trained machine learning classifiers having been trainedbased on at least a portion of the information received from theplurality of artists; exposing an application programming interface(API) of one or more APIs to at least one financial system of theplurality of financial systems for electronic communication of financialinformation at least one of to or from the at least one financialsystem; and generating, using the one or more trained machine learningclassifiers and based at least on information obtained from the at leastone financial system, context data, and/or information of the mediacontent, user interface including the offer for the financing, whereinthe offer specifies terms for the financing and the particular amount ofthe financing determined based at least in part on an evaluation of anamount collected by the first customer from usage of the media contentby others, and wherein repayment terms include a portion of revenue as aresult of the usage of the media content; sending, by the computingdevice to the payment processing system, an indication of an acceptanceof the offer for the financing received via the user interface; andreceiving, to the first customer device, an indication that a financedamount has been provided to an account associated with the firstcustomer.

Aspect 62. A computer implemented method comprising: determining whetherto assign a value to one or more portions of a media content;determining a total value of non-fungible tokens for the media contentbased on the assignment to the one or more portion of the song/track;determining a digital right to associate to each of the non-fungibletokens; entering the value of non-fungible tokens using a user interfaceassociated with a user that provides access to a distributed ledgernetwork; generating non-fungible tokens on distributed ledger networkand storing ownership of the non-fungible tokens in a database; andexecuting a smart contract that assigns the ownership of non-fungibletokens and/or assignment of digital rights when at least one of thefollowing occurs: a user subscribes to the media content; the user rentsthe media content; the user downloads the media content; or the userpurchases the media content.

Aspect 63. A computer implemented method comprising: receiving a requestfrom a second user to subscribe to a media content stream of a firstuser; synchronizing broadcast of the media content stream to the seconduser's device such that the media content stream is at the same instanceas the instance where the first user is; and enabling provisionalcommunication between the first user and the second user.

Aspect 64. The method of aspect 63, wherein the provisionalcommunication enables the second user to control the media contentstream and modify the media content stream.

Aspect 65. The method of anyone of aspects 63-64 wherein the provisionalcommunication enables the first user and the second user to engage intransactions, including one of merchandise sales, media content sales,media content feedback, media content NFT purchases, incentives,rewards, ticket sales, payment transactions, tipping transaction, andmedia content playlist generation.

Aspect 66. The method of aspects 63-65, where the request is in responseto an initial request generated by the first user on a music serviceplatform, a third party platform, or a social networking platform, andwherein a device associated with the first user visually displays statusof the second user and other users in terms of their engagement with themedia content of the first user, and wherein a heat map indicatesstrength of their engagement.

What is claimed is:
 1. A method comprising: receiving, from an artistaccount associated with an artist on a media platform, an indication ofa product associated with the artist available for sale by an e-commerceservice in response to a condition being met; receiving, from a useraccount on the media platform, a request to generate a playlist toinclude first media content from a first collection associated with theuser account and second media content from a second collectionassociated with another user account; identifying a shared attributebetween a first media content item included in the first collection anda second media content item included in the second collection; based onidentifying the shared attribute: generating the playlist to include thefirst media content item and the second media content item; anddetermining that the condition has been met; and based on determiningthat the condition has been met, providing the user account with accessto: the playlist; and an interactive element that, when selected, causesa computing device associated with the user account to be directed tothe e-commerce service at which the product is available for sale. 2.The method of claim 1, wherein the another user account is the artistaccount, the method further comprising: determining that the artistaccount is a verified artist account that is associated with the secondmedia content.
 3. The method of claim 1, wherein the shared attributebetween the first media content item included in the first collectionand the second media content item included in the second collection isone of a genre, artist, or tempo.
 4. The method of claim 1, wherein thecondition is that the user is currently listening to a live streamhosted by the artist account.
 5. The method of claim 1, wherein thecondition is that the user is interacting with an interactive featurepresented during playback of the playlist by the user account.
 6. Anon-transitory computer-readable storage medium, the computer-readablestorage medium including instructions that when executed by a computer,cause the computer to: receive, from a user account on a media platform,a request to generate a playlist to include first media content from afirst collection associated with the user account and second mediacontent from a second collection associated with another user account;generate the playlist to include the first media content and the secondmedia content; determine that a condition has been met based on thereceiving the request for generating the playlist wherein the conditionincludes an identification of the user account as recommended to theanother user account; and based on determining that the condition hasbeen met, provide the user account with access to: the playlist; and aninteractive element that, when selected, causes a computing deviceassociated with the user account to be directed to an e-commerce serviceat which a product is available for sale.
 7. The computer-readablestorage medium of claim 6, wherein the product available for saleincludes merchandise customized for the user account.
 8. Thecomputer-readable storage medium of claim 6, wherein the conditionincludes that the user account has engaged with a particular playlistassociated with the another user account.
 9. The computer-readablestorage medium of claim 6, wherein the condition includes thatcollaboration data associated with the user account indicates apreference of the user account for the first media content and thesecond media content.
 10. The computer-readable storage medium of claim6, wherein the condition is provided by a collaboration component of themedia platform.
 11. The computer-readable storage medium of claim 6,wherein the another user account is an artist account, and the productavailable for sale is provided by a store page associated with theartist account at the e-commerce service.
 12. The computer-readablestorage medium of claim 11, wherein the instructions further configurethe computer to: determine that the artist account is a verified artistaccount that is associated with the second media content.
 13. Thecomputer-readable storage medium of claim 6, further wherein the productthat is available for sale is unavailable for sale to a second useraccount that has not met the condition based on the receiving therequest for generating the playlist.
 14. A computing system comprising:a processor; and a memory storing instructions that, when executed bythe processor, configures the system to: receive, from a user account ona media platform, a request to generate a playlist to include firstmedia content from a first collection associated with the user accountand second media content from a second collection associated withanother user account; generate the playlist to include the first mediacontent and the second media content; determine that a condition hasbeen met based on the receiving the request for generating the playlistwherein the condition includes an identification of the user account asrecommended to the another user account; and based on determining thatthe condition has been met, provide the user account with access to: theplaylist; and an interactive element that, when selected, causes acomputing device associated with the user account to be directed to ane-commerce service at which a product is available for sale.
 15. Thecomputing system of claim 14, wherein the product available for saleincludes merchandise customized for the user account.
 16. The computingsystem of claim 14, wherein the condition includes that the user accounthas engaged with a particular playlist associated with the another useraccount.
 17. The computing system of claim 14, wherein the conditionincludes that collaboration data associated with the user accountindicates a preference of the user account for the first media contentand the second media content.
 18. The computing system of claim 14,wherein the condition is provided by a collaboration component of themedia platform.
 19. The computing system of claim 14, wherein theanother user account is an artist account, and the product available forsale is provided by a store page associated with the artist account atthe e-commerce service.
 20. The computing system of claim 19, whereinthe instructions further configure the apparatus to: determine that theartist account is a verified artist account that is associated with thesecond media content.